00000001:02000400:1.0F:1789672411.263900:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789672432.061977:0:3176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789672434.080143:0:3235:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 701 MB/s 00000001:01000000:2.0:1789672434.329904:0:3235:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 819 MB/s 00000001:01000000:2.0:1789672434.580270:0:3235:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3659 MB/s 00000020:02000000:1.0:1789672435.343212:0:3267:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g9373f0b 00000400:02000000:2.0:1789672436.155817:0:3283:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.139@tcp [8/256/0/180] 00008000:02000000:2.0:1789672439.675118:0:3432:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1789672489.467480:0:5236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1789672502.412459:0:5811:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789672502.412473:0:5811:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789672502.412921:0:5811:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004719501e 00000080:02000400:3.0:1789672502.412932:0:5811:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789672502.419199:0:5811:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789672502.419211:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789672502.419248:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000041dcb2ad) 00000020:00000080:3.0:1789672502.419266:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789672502.440470:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789672502.441219:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789672502.478823:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789672502.478870:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789672502.478890:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789672502.478940:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789672502.478967:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789672502.482207:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789672502.482222:0:5811:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789672502.482236:0:5811:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d084dc 00000020:01000004:3.0:1789672502.482714:0:5811:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789672502.482721:0:5811:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789672502.482729:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004719501e from MGS 00000020:01000004:3.0:1789672502.482733:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789672502.482746:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000014c3f0c8) 00000020:00000080:3.0:1789672502.482759:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789672502.482846:0:5811:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004719501e from MGS, refs=2 00080000:01000000:3.0:1789672502.482852:0:5811:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789672502.482857:0:5811:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d084ea 00000100:00100000:3.0:1789672502.483026:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789672502.487153:0:5811:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789672502.487168:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789672502.487943:0:5811:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789672502.487952:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789672502.488589:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672502.488825:0:5811:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789672502.488831:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789672502.495625:0:5811:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789672502.495647:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789672502.496284:0:5811:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789672502.496291:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789672502.496908:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672502.496918:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672502.496920:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672502.497191:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672502.497194:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672502.497195:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672502.497880:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789672502.506020:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789672502.749033:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3166 MB/s 00000001:01000000:0.0:1789672502.999641:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2595 MB/s 00000001:01000000:0.0:1789672503.254186:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 552 MB/s 00000001:01000000:2.0:1789672503.506323:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 936 MB/s 00080000:10000000:3.0:1789672503.525757:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1789672503.540057:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789672503.578578:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789672503.578611:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789672503.578614:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789672503.584669:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789672503.584776:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789672503.585033:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789672503.585418:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789672503.585448:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789672503.586529:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672503.586728:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789672503.586735:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789672503.587648:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789672503.587658:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789672503.588160:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789672503.588170:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789672503.588888:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789672503.588914:0:5811:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.139@tcp' 00000020:01000004:2.0:1789672503.588918:0:5811:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789672503.588983:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.139@tcp (typ=mgc) 00000020:00000080:2.0:1789672503.589009:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.139@tcp (00000000bbdf8b4d) 00000020:00000080:2.0:1789672503.589031:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789672503.589156:0:5811:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009385b0ba@MGC192.168.202.139@tcp: add connection 192.168.202.139@tcp at head 00010000:00010000:2.0:1789672503.589338:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.139@tcp-0 is initialized 00000040:01000000:2.0:1789672503.589346:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789672503.591583:0:5826:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789672503.593350:0:5827:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789672503.595995:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.139@tcp (uuid 3c6595f6-f042-46a8-abe4-2c10b8a32248) 00000020:00000080:2.0:1789672503.596025:0:5811:0:(genops.c:1384:class_connect()) connect: client 3c6595f6-f042-46a8-abe4-2c10b8a32248, cookie 0x2247cb9491d084f8 00000100:00080000:2.0:1789672503.596039:0:5811:0:(import.c:545:import_select_connection()) MGC192.168.202.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672503.596050:0:5811:0:(import.c:666:import_select_connection()) MGC192.168.202.139@tcp: import 000000009385b0ba using connection 192.168.202.139@tcp/0@lo 00000100:00100000:2.0:1789672503.596108:0:5811:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001f50c380 x1876607564251264/t0(0) o250->MGC192.168.202.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789672503.596202:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c6595f6-f042-46a8-abe4-2c10b8a32248:3298:1876607564251264:0@lo:250: 00000100:00100000:2.0:1789672503.596302:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672503.596376:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564251264 00000100:00100000:2.0:1789672503.596382:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564251264 00000100:00100000:2.0:1789672503.596410:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672503.596418:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093ea13b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1876607564251264:12345-0@lo:250: 00010000:00080000:2.0:1789672503.596441:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3c6595f6-f042-46a8-abe4-2c10b8a32248@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1789672503.596477:0:5823:0:(genops.c:1384:class_connect()) connect: client 3c6595f6-f042-46a8-abe4-2c10b8a32248, cookie 0x2247cb9491d084ff 00000100:00080000:2.0:1789672503.596661:0:5823:0:(import.c:65:import_set_state_nolock()) 0000000004502620 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672503.596718:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093ea13b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:3298:x1876607564251264:12345-0@lo:250: Request processed in 300us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672503.596726:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672503.596767:0:3298:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789672503.596776:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.139@tcp: connect to target with instance 0 00000100:00080000:2.0:1789672503.596783:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789672503.596808:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789672503.596812:0:3298:0:(import.c:65:import_set_state_nolock()) 000000009385b0ba MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789672503.596814:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789672503.596822:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789672503.596828:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c6595f6-f042-46a8-abe4-2c10b8a32248:3298:1876607564251264:0@lo:250: 00000100:00080000:2.0:1789672503.596851:0:5811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3c6595f6-f042-46a8-abe4-2c10b8a32248->MGS 00000020:01000004:2.0:1789672503.596874:0:5811:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789672503.596900:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789672503.596914:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000dad86d7d) 00000020:00000080:2.0:1789672503.596927:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789672503.613141:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672503.616346:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789672503.616361:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789672503.618524:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789672503.618538:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789672503.619161:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789672503.619168:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789672503.619936:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672503.620105:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789672503.620109:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789672503.621211:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789672503.621219:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789672503.702303:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672503.704091:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789672503.704104:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789672503.711074:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789672503.711097:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789672503.715112:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672503.715584:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789672503.715592:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789672503.742820:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789672503.742839:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789672503.743730:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672503.743937:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789672503.743943:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789672503.755782:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789672503.755921:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789672503.767366:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672503.767775:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789672503.767828:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789672503.769141:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789672503.769154:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789672503.815952:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672503.817355:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789672503.817368:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789672503.826589:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789672503.826607:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789672503.838914:0:5811:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789672503.838936:0:5811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789672503.846068:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789672503.846094:0:5811:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789672503.846100:0:5811:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789672503.846227:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789672503.846264:0:5811:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.139@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789672503.846268:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789672503.846270:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789672503.846271:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789672503.846276:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789672503.846278:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789672503.846279:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789672503.846280:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789672503.846281:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789672503.846282:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789672503.846284:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789672503.846285:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789672503.846286:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789672503.846289:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789672503.846291:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789672503.846291:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789672503.846292:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789672503.846293:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789672503.846294:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789672503.846295:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789672503.846296:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789672503.846297:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789672503.846297:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789672503.846298:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789672503.846299:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789672503.846300:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789672503.846341:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789672503.846359:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ded9b4af pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251392:0@lo:253: 00000100:00100000:3.0:1789672503.846446:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672503.846523:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564251392 00000100:00100000:2.0:1789672503.846531:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564251392 00000100:00100000:3.0:1789672503.846596:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b62a44e going to sleep for 11 seconds 00000100:00100000:2.0:1789672503.846626:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672503.846634:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a32b15f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:5811:x1876607564251392:12345-0@lo:253: 20000000:01000000:2.0:1789672503.846694:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789672503.846697:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789672503.847167:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789672503.847295:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789672503.847598:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672503.848656:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789672503.849162:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789672503.849166:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789672503.849172:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789672503.849175:0:5825:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789672503.849191:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789672503.849467:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672503.849778:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789672503.850143:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789672503.850202:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789672503.850333:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789672503.850373:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789672503.850480:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789672503.850500:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789672503.850564:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789672503.850574:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789672503.850610:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789672503.850618:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789672503.850667:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789672503.850907:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789672503.850943:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789672503.850949:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789672503.850964:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672503.851161:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789672503.851172:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789672503.851205:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789672503.851322:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789672503.851369:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789672503.851389:0:5825:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789672503.851458:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789672503.851466:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789672503.851539:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789672503.851579:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789672503.851613:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789672503.851624:0:5825:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789672503.851879:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789672503.851889:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789672503.851927:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789672503.851963:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789672503.852124:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789672503.852170:0:5825:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789672503.852176:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789672503.852921:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789672503.853202:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789672503.853307:0:5825:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.139@tcp for mdt 20000000:01000000:2.0:1789672503.853309:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.139@tcp (null) (null) (null) 00000040:00080000:2.0:1789672503.853362:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789672503.853370:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789672503.853402:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789672503.853409:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.139@tcp (null) (null) 00000040:00080000:2.0:1789672503.853477:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789672503.853500:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789672503.853537:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789672503.853574:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789672503.853636:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789672503.853640:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789672503.853645:0:5825:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789672503.853651:0:5825:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789672503.854611:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789672503.855004:0:5825:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789672503.866200:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789672503.867903:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789672503.867983:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789672503.868004:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789672503.868007:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789672503.868010:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789672503.868023:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789672503.868025:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789672503.868060:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789672503.868063:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789672503.869990:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789672503.870306:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789672503.870354:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789672503.870433:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789672503.870449:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789672503.870451:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789672503.871288:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789672503.871473:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789672503.871534:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789672503.871569:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789672503.871592:0:5825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789672503.871594:0:5825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789672503.871601:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789672503.871620:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871636:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871647:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871652:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871658:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871864:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871873:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b5fb7fc already unused, calling callback (000000008ff1ddda) 00010000:00010000:3.0:1789672503.871876:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871884:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871897:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871904:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672503.871921:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b5fb7fc/0x2247cb9491d0850d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672503.871938:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789672504.173267:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a32b15f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:5811:x1876607564251392:12345-0@lo:253: Request processed in 326626us (326814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.173294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672504.173441:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ded9b4af pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251392:0@lo:253: 10000000:01000000:2.0:1789672504.173462:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789672504.173466:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672504.173468:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789672504.173469:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672504.173471:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789672504.173472:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672504.173473:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672504.173474:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672504.173476:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789672504.173478:0:5811:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789672504.173480:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672504.173481:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789672504.173516:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004719501e from lustre-MDT0000 10000000:01000000:2.0:1789672504.173542:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789672504.173545:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789672504.173550:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fa6103db380 10000000:01000000:2.0:1789672504.173555:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789672504.173567:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa6103db380 from 1 10000000:01000000:2.0:1789672504.173570:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789672504.173619:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.173640:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.173652:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672504.173745:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f50c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251520:0@lo:101: 00000100:00100000:2.0:1789672504.173876:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.173965:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f62891e going to sleep for 11 seconds 00000100:00100000:0.0:1789672504.174086:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564251520 00000100:00100000:0.0:1789672504.174094:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564251520 00000100:00100000:0.0:1789672504.174195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672504.174204:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006855bf48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:5811:x1876607564251520:12345-0@lo:101: 00010000:00010000:0.0:1789672504.174222:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672504.174237:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be96ea90/0x2247cb9491d0851b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08514 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672504.174261:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be96ea90/0x2247cb9491d0851b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08514 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672504.174272:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be96ea90/0x2247cb9491d0851b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08514 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672504.174281:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be96ea90, rc 0) 00000100:00100000:0.0:1789672504.174331:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006855bf48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+6:5811:x1876607564251520:12345-0@lo:101: Request processed in 128us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672504.174345:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672504.174419:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f50c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251520:0@lo:101: 00010000:00010000:3.0:1789672504.174435:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.174444:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.174509:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251648:0@lo:501: 00000100:00100000:3.0:1789672504.174551:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.174627:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baad1ef8 going to sleep for 11 seconds 00000100:00100000:2.0:1789672504.174708:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564251648 00000100:00100000:2.0:1789672504.174713:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564251648 00000100:00100000:2.0:1789672504.174736:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672504.174741:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df32db20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+6:5811:x1876607564251648:12345-0@lo:501: 00000100:00100000:2.0:1789672504.175230:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df32db20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+6:5811:x1876607564251648:12345-0@lo:501: Request processed in 488us (678us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672504.175238:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672504.175344:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251648:0@lo:501: 10000000:01000000:3.0:1789672504.175372:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789672504.175390:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.175398:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 0000000014695ff3/0x2247cb9491d08514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672504.175407:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa604b25800 10000000:01000000:3.0:1789672504.175412:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789672504.175416:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fa604b25800 10000000:01000000:3.0:1789672504.175418:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789672504.175421:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fa604b25800 from 1 10000000:01000000:3.0:1789672504.175429:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789672504.175452:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.175460:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.175469:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.175494:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251776:0@lo:101: 00000100:00100000:3.0:1789672504.175524:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.175559:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baad1ef8 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.175721:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564251776 00000100:00100000:1.0:1789672504.175728:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564251776 00000100:00100000:1.0:1789672504.175839:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672504.175847:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006901b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+6:5811:x1876607564251776:12345-0@lo:101: 00010000:00010000:1.0:1789672504.175857:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672504.175869:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ba39d59/0x2247cb9491d08529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08522 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.175886:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ba39d59/0x2247cb9491d08529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08522 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.175894:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ba39d59/0x2247cb9491d08529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08522 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.175900:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ba39d59, rc 0) 00000100:00100000:1.0:1789672504.175941:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006901b64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+7:5811:x1876607564251776:12345-0@lo:101: Request processed in 96us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.175947:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672504.176006:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251776:0@lo:101: 00010000:00010000:3.0:1789672504.176017:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.176024:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672504.176035:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789672504.176049:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.176055:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 000000002b5fb7fc/0x2247cb9491d08522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672504.176061:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789672504.176064:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789672504.176067:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fa604b25800 10000000:01000000:3.0:1789672504.176078:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789672504.176081:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789672504.176082:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789672504.176096:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.176102:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.176108:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.176116:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251904:0@lo:101: 00000100:00100000:3.0:1789672504.176138:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.176245:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baad1ef8 going to sleep for 11 seconds 00000100:00100000:2.0:1789672504.176307:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564251904 00000100:00100000:2.0:1789672504.176312:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564251904 00000100:00100000:2.0:1789672504.176331:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672504.176337:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090797ed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+7:5811:x1876607564251904:12345-0@lo:101: 00010000:00010000:2.0:1789672504.176344:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672504.176353:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000910a6a5d/0x2247cb9491d08537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08530 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.176366:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000910a6a5d/0x2247cb9491d08537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08530 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.176374:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000910a6a5d/0x2247cb9491d08537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08530 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.176386:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000910a6a5d, rc 0) 00000100:00100000:2.0:1789672504.176426:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090797ed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+8:5811:x1876607564251904:12345-0@lo:101: Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672504.176432:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789672504.176551:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564251904:0@lo:101: 00010000:00010000:3.0:1789672504.176560:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.176567:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.176610:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252032:0@lo:501: 00000100:00100000:3.0:1789672504.176634:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.176655:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baad1ef8 going to sleep for 11 seconds 00000100:00100000:2.0:1789672504.176780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252032 00000100:00100000:2.0:1789672504.176803:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252032 00000100:00100000:2.0:1789672504.176832:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672504.176837:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e794df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+8:5811:x1876607564252032:12345-0@lo:501: 00000100:00100000:2.0:1789672504.177060:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e794df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5811:x1876607564252032:12345-0@lo:501: Request processed in 223us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672504.177067:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672504.177137:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252032:0@lo:501: 00000100:00100000:3.0:1789672504.177166:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252160:0@lo:503: 00000100:00100000:3.0:1789672504.177203:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.177239:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baad1ef8 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.177297:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252160 00000100:00100000:1.0:1789672504.177303:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252160 00000100:00100000:1.0:1789672504.177324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789672504.177329:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e30d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5811:x1876607564252160:12345-0@lo:503: 00000100:00100000:1.0:1789672504.177502:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e30d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5811:x1876607564252160:12345-0@lo:503: Request processed in 173us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.177508:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672504.177589:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252160:0@lo:503: 00000100:00100000:2.0:1789672504.178104:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f228d7b pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5854:1876607564252288:0@lo:502: 00000100:00100000:2.0:1789672504.178148:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.178180:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2893e55 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.178234:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252288 00000100:00100000:1.0:1789672504.178239:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252288 00000100:00100000:1.0:1789672504.178269:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672504.178275:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a32d9a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5854:x1876607564252288:12345-0@lo:502: 00000100:00100000:1.0:1789672504.178525:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a32d9a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5854:x1876607564252288:12345-0@lo:502: Request processed in 250us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.178531:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789672504.178930:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f228d7b pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5854:1876607564252288:0@lo:502: 00000020:01000000:3.0:1789672504.178959:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672504.178970:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672504.178972:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789672504.178976:0:5854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789672504.178979:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672504.178992:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000448f539b) 00000020:00000080:3.0:1789672504.179011:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789672504.179016:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789672504.179106:0:5854:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789672504.179113:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d08545 00000020:00000080:3.0:1789672504.179368:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789672504.179372:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672504.179375:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672504.179376:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789672504.179379:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672504.179382:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672504.179383:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789672504.179386:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672504.179392:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ce88f065) 00000020:00000080:3.0:1789672504.179401:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789672504.179404:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789672504.179406:0:5854:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789672504.179408:0:5854:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789672504.179414:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789672504.179450:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004719501e from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789672504.179470:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000051a65429) 00000020:00000080:3.0:1789672504.179479:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789672504.179545:0:5854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789672504.179549:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d0855a 00000020:00000080:3.0:1789672504.179658:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789672504.179739:0:5854:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789672504.179744:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2247cb9491d08561 00080000:01000000:3.0:1789672504.179750:0:5854:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789672504.179753:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d08568 00080000:10000000:3.0:1789672504.180183:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789672504.180406:0:5854:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789672504.184404:0:5854:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789672504.243743:0:5854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789672504.244149:0:5854:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789672504.246583:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789672504.247041:0:5854:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789672504.267390:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000736c6dd7) 00000020:00000080:3.0:1789672504.267417:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789672504.267506:0:5854:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789672504.267512:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d08576 00000020:00000080:1.0:1789672504.269020:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789672504.270554:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672504.309453:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672504.331876:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672504.352993:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672504.391497:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789672504.451419:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789672504.514937:0:5854:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2247cb9491d0857d 00000020:00000080:0.0:1789672504.515830:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789672504.515847:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672504.515855:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672504.515859:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789672504.515864:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672504.515872:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672504.515873:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789672504.515878:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789672504.515932:0:5854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789672504.515949:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672504.515952:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672504.515953:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789672504.515956:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672504.515958:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672504.515959:0:5854:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789672504.515962:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789672504.515964:0:5854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789672504.516046:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a02ff420 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5854:1876607564252416:0@lo:502: 00000100:00100000:0.0:1789672504.516151:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672504.516220:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026e6d01d going to sleep for 11 seconds 00000100:00100000:0.0:1789672504.516277:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252416 00000100:00100000:0.0:1789672504.516287:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252416 00000100:00100000:0.0:1789672504.516340:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672504.516350:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be12ede6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5854:x1876607564252416:12345-0@lo:502: 00000100:00100000:0.0:1789672504.517435:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be12ede6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5854:x1876607564252416:12345-0@lo:502: Request processed in 1079us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672504.517468:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672504.517636:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a02ff420 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5854:1876607564252416:0@lo:502: 00000020:01000000:1.0:1789672504.517689:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672504.517697:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672504.517699:0:5854:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789672504.517703:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789672504.517947:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789672504.517971:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789672504.517985:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.517998:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 000000004da3d2ec/0x2247cb9491d08530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672504.518007:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa604b25800 from 1 10000000:01000000:2.0:1789672504.518010:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789672504.518051:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.518071:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.518082:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672504.518101:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000124151c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252544:0@lo:101: 00000100:00100000:2.0:1789672504.518143:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.518182:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011d2a896 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.518351:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252544 00000100:00100000:1.0:1789672504.518360:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252544 00000100:00100000:1.0:1789672504.518409:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672504.518417:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6b1d13d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:5811:x1876607564252544:12345-0@lo:101: 00010000:00010000:1.0:1789672504.518432:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672504.518449:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08584 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.518477:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08584 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.518500:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08584 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.518524:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4ad8db3, rc 0) 00000100:00100000:1.0:1789672504.518577:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6b1d13d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:5811:x1876607564252544:12345-0@lo:101: Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.518583:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789672504.518667:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000124151c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252544:0@lo:101: 00010000:00010000:2.0:1789672504.518682:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.518692:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672504.519286:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000124151c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252672:0@lo:256: 00000100:00100000:2.0:1789672504.519339:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.519366:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011d2a896 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.519553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252672 00000100:00100000:1.0:1789672504.519560:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252672 00000100:00100000:1.0:1789672504.519599:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789672504.519606:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ad1a0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:5811:x1876607564252672:12345-0@lo:256: 20000000:01000000:1.0:1789672504.519626:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789672504.519634:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789672504.519729:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ad1a0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:5811:x1876607564252672:12345-0@lo:256: Request processed in 124us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.519737:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672504.520081:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000124151c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252672:0@lo:256: 10000000:01000000:2.0:1789672504.520771:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789672504.520875:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.520889:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672504.520916:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa604b25800 from 1 10000000:01000000:2.0:1789672504.520920:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672504.520958:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.520965:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.520976:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672504.520994:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000124151c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252800:0@lo:101: 00000100:00100000:2.0:1789672504.521044:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.521125:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011d2a896 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.521586:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252800 00000100:00100000:1.0:1789672504.521597:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252800 00000100:00100000:1.0:1789672504.521666:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789672504.521675:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ba82cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:5811:x1876607564252800:12345-0@lo:101: 00010000:00010000:1.0:1789672504.521690:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672504.521706:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08592 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.521733:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08592 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.521743:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08592 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.521766:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2c76179, rc 0) 00000100:00100000:1.0:1789672504.521878:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ba82cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564252800:12345-0@lo:101: Request processed in 204us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.521885:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672504.522063:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000124151c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252800:0@lo:101: 00010000:00010000:3.0:1789672504.522081:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.522091:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.522158:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252928:0@lo:501: 00000100:00100000:3.0:1789672504.522190:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.522227:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000003da10879 going to sleep for 11 seconds 00000100:00100000:0.0:1789672504.522292:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564252928 00000100:00100000:0.0:1789672504.522298:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564252928 00000100:00100000:0.0:1789672504.522331:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672504.522338:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa518288 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564252928:12345-0@lo:501: 00000100:00100000:0.0:1789672504.523041:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa518288 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564252928:12345-0@lo:501: Request processed in 702us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672504.523050:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789672504.523242:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564252928:0@lo:501: 00000100:00100000:3.0:1789672504.523288:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253056:0@lo:503: 00000100:00100000:3.0:1789672504.523345:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.523382:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000003da10879 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.523463:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253056 00000100:00100000:1.0:1789672504.523469:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253056 00000100:00100000:1.0:1789672504.523510:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672504.523517:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aadf5d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564253056:12345-0@lo:503: 00000040:00080000:1.0:1789672504.523563:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672504.523615:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aadf5d77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564253056:12345-0@lo:503: Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.523622:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789672504.523781:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253056:0@lo:503: 00000040:00080000:0.0:1789672504.525592:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789672504.527117:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789672504.527155:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789672504.527223:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.527241:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672504.527311:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789672504.527314:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa604b25800 10000000:01000000:3.0:1789672504.527318:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa604b25800 10000000:01000000:3.0:1789672504.527323:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789672504.527330:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa604b25800 from 1 10000000:01000000:3.0:1789672504.527334:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672504.527387:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.527397:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.527409:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.527439:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253184:0@lo:101: 00000100:00100000:3.0:1789672504.527542:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.527607:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069cb2905 going to sleep for 11 seconds 00000100:00100000:2.0:1789672504.528460:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253184 00000100:00100000:2.0:1789672504.528474:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253184 00000100:00100000:2.0:1789672504.528559:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672504.528569:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c909ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564253184:12345-0@lo:101: 00010000:00010000:2.0:1789672504.528589:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672504.528609:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091088894/0x2247cb9491d085a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d085a0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.528642:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091088894/0x2247cb9491d085a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.528652:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091088894/0x2247cb9491d085a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.528673:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091088894, rc 0) 00000100:00100000:2.0:1789672504.528767:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c909ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5811:x1876607564253184:12345-0@lo:101: Request processed in 199us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672504.528774:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789672504.529049:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253184:0@lo:101: 00010000:00010000:3.0:1789672504.529072:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.529082:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.529178:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253312:0@lo:501: 00000100:00100000:3.0:1789672504.529216:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.529248:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069cb2905 going to sleep for 11 seconds 00000100:00100000:2.0:1789672504.529314:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253312 00000100:00100000:2.0:1789672504.529320:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253312 00000100:00100000:2.0:1789672504.529363:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789672504.529370:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054f73189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5811:x1876607564253312:12345-0@lo:501: 00000100:00100000:2.0:1789672504.529929:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054f73189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5811:x1876607564253312:12345-0@lo:501: Request processed in 556us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672504.529939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789672504.532754:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253312:0@lo:501: 00000100:00100000:3.0:1789672504.533075:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253440:0@lo:503: 00000100:00100000:3.0:1789672504.533180:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.534901:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069cb2905 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.535141:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253440 00000100:00100000:1.0:1789672504.535155:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253440 00000100:00100000:1.0:1789672504.535287:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672504.535299:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d0b7231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5811:x1876607564253440:12345-0@lo:503: 00000100:00100000:1.0:1789672504.535887:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d0b7231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5811:x1876607564253440:12345-0@lo:503: Request processed in 588us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672504.535898:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672504.536035:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e46702cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253440:0@lo:503: 00000100:00100000:2.0:1789672504.537017:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076d31a75 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5859:1876607564253568:0@lo:502: 00000100:00100000:2.0:1789672504.537100:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.542972:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000363342ca going to sleep for 11 seconds 00000100:00100000:3.0:1789672504.543435:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253568 00000100:00100000:3.0:1789672504.543452:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253568 00000100:00100000:3.0:1789672504.543544:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789672504.543556:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f55ae843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5859:x1876607564253568:12345-0@lo:502: 00000100:00100000:3.0:1789672504.544208:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f55ae843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5859:x1876607564253568:12345-0@lo:502: Request processed in 652us (7107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672504.544218:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672504.548024:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076d31a75 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5859:1876607564253568:0@lo:502: 00000020:01000004:2.0:1789672504.548170:0:5859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789672504.548193:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002565104c) 00000020:00000080:2.0:1789672504.548220:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789672504.548355:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004719501e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789672504.548360:0:5859:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004719501e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789672504.548363:0:5859:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004719501e 4 00010000:00080000:2.0:1789672504.548408:0:5859:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000185db624@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.139@tcp at head 00010000:00010000:2.0:1789672504.556024:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789672504.556305:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789672504.556366:0:5859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789672504.556387:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2247cb9491d085b5 00000100:00080000:2.0:1789672504.556400:0:5859:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672504.556424:0:5859:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000185db624 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:2.0:1789672504.562926:0:5859:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000076d31a75 x1876607564253696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672504.562974:0:5859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789672504.563559:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076d31a75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564253696:0@lo:38: 00000100:00100000:0.0:1789672504.563732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672504.564105:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011165fc9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5859:1876607564253824:0@lo:502: 00000100:00100000:0.0:1789672504.564162:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672504.564183:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 0000000081458863 going to sleep for 11 seconds 00000100:00100000:1.0:1789672504.564514:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253696 00000100:00100000:1.0:1789672504.564525:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253696 00000100:00100000:1.0:1789672504.564584:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672504.564594:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000924ec2a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564253696:12345-0@lo:38: 00000100:00100000:3.0:1789672504.564633:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253824 00000100:00100000:3.0:1789672504.564648:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253824 00000100:00100000:1.0:1789672504.564689:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000924ec2a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564253696:12345-0@lo:38: Request processed in 94us (957us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789672504.564699:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672504.564732:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672504.564745:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b99c1f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5859:x1876607564253824:12345-0@lo:502: 00000100:00100000:1.0:1789672504.564778:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672504.564820:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000185db624 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789672504.564826:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789672504.564830:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076d31a75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564253696:0@lo:38: 00000100:00100000:3.0:1789672504.565126:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b99c1f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5859:x1876607564253824:12345-0@lo:502: Request processed in 384us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672504.565157:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672504.565231:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011165fc9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:5859:1876607564253824:0@lo:502: 00000040:00080000:3.0:1789672504.565267:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789672504.567973:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789672504.568033:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672504.568058:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672504.568075:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 0000000032e21f55/0x2247cb9491d085a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789672504.568172:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789672504.568175:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672504.568177:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672504.568178:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672504.568179:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672504.568181:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672504.568182:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672504.568192:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672504.568193:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672504.568194:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672504.568195:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672504.568197:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789672504.568202:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789672504.568204:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789672504.568205:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672504.568206:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672504.568207:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672504.568208:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672504.568209:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672504.568210:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672504.568210:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672504.568211:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672504.568212:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672504.568213:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672504.568214:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789672504.568248:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789672504.568269:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1f1ad40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253952:0@lo:253: 00000100:00100000:0.0:1789672504.568354:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672504.568403:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000081458863 going to sleep for 11 seconds 00000100:00100000:0.0:1789672504.568434:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564253952 00000100:00100000:0.0:1789672504.568441:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564253952 00000100:00100000:0.0:1789672504.568511:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789672504.568524:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004fbdf17a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5811:x1876607564253952:12345-0@lo:253: 00010000:00010000:2.0:1789672504.568566:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1789672504.568569:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789672504.568588:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789672504.605847:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789672504.605868:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789672504.606817:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789672504.606829:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789672504.606865:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.606892:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08584 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.606901:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.606972:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08584 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672504.606995:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08584 expref: 12 pid: 5825 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672504.607013:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef5c1c15 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876607564254080:0@lo:104: 00000100:00100000:2.0:1789672504.607117:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672504.607247:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b6351d8 going to sleep for 11 seconds 00000100:00100000:0.0:1789672504.610981:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254080 00000100:00100000:0.0:1789672504.611006:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254080 00000100:00100000:0.0:1789672504.611078:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672504.611089:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c517b3c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5846:x1876607564254080:12345-0@lo:104: 00010000:00010000:0.0:1789672504.611114:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672504.611276:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672504.611282:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c517b3c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5846:x1876607564254080:12345-0@lo:104: Request processed in 196us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672504.611291:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789672504.611525:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672504.611534:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.611542:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e534454f already unused, calling callback (0000000079ce76aa) 10000000:00010000:1.0:1789672504.611547:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.611556:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672504.611564:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672504.611570:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672504.611655:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.611663:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672504.611686:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.611693:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: 00000000e534454f/0x2247cb9491d08584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0858b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672504.611733:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672504.611744:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672504.611745:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672504.611935:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a2aebe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564254208:0@lo:103: 00000100:00100000:3.0:1789672504.612008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672504.612161:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254208 00000100:00100000:3.0:1789672504.612167:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254208 00010000:00010000:3.0:1789672504.612194:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08584 expref: 13 pid: 5825 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.612229:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672504.612236:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c06dc711 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3300:x1876607564254208:12345-0@lo:103: 00010000:00010000:3.0:1789672504.612253:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672504.612259:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08584 expref: 13 pid: 5825 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612270:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08584 expref: 13 pid: 5825 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612291:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612301:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672504.612323:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005495827s 00010000:00010000:3.0:1789672504.612328:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612345:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612352:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612357:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612363:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0221a81 already unused, calling callback (000000008ff1ddda) 00010000:00010000:3.0:1789672504.612368:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612376:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612385:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612398:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672504.612436:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c06dc711 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3300:x1876607564254208:12345-0@lo:103: Request processed in 201us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672504.612444:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672504.612500:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a2aebe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564254208:0@lo:103: 00010000:00010000:3.0:1789672504.612539:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d4ad8db3/0x2247cb9491d0858b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08584 expref: 12 pid: 5825 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672504.612551:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef5c1c15 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876607564254080:0@lo:104: 00010000:00010000:3.0:1789672504.612565:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612579:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672504.612590:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0221a81/0x2247cb9491d085bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672504.620935:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004fbdf17a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5811:x1876607564253952:12345-0@lo:253: Request processed in 52401us (52568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672504.620956:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789672504.621095:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1f1ad40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:5811:1876607564253952:0@lo:253: 10000000:01000000:2.0:1789672504.621116:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789672504.621119:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672504.621122:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789672504.621123:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672504.621155:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672504.621156:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672504.621158:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672504.621159:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672504.621161:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789672504.621163:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672504.621164:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672504.621166:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672504.621167:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789672504.621186:0:5811:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789672504.630426:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672504.631467:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672504.632541:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672504.632952:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672504.633230:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672504.633441:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789672504.635311:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789672504.635531:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789672504.635960:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789672504.636195:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789672504.636398:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789672504.636599:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789672504.738069:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789672504.841287:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789672504.841602:0:5864:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789672504.841607:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789672504.841739:0:5865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789672504.859908:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789672504.860372:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789672504.860853:0:5811:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789672504.860862:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789672504.861022:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672504.862019:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789672504.866311:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789672504.866397:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789672504.867120:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789672504.867338:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789672504.868708:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789672504.869840:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789672504.870012:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789672504.870175:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789672504.870339:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789672504.872065:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789672504.872310:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789672504.872448:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789672504.872612:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789672504.872965:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789672504.873120:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789672504.873255:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789672504.873519:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789672504.873673:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789672504.873870:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789672504.874003:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789672504.874317:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789672504.874473:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789672504.874638:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789672504.874771:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789672504.874963:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789672504.875118:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789672504.875269:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789672504.875404:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789672504.876519:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789672504.876688:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789672504.876871:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789672504.876999:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789672504.877125:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789672504.877235:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789672504.877371:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789672504.877534:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789672504.877752:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789672504.901841:0:5865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789672504.978350:0:5811:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789672504.978519:0:5811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb88781d6b988 00100000:10000000:1.0:1789672504.978529:0:5811:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789672504.982757:0:5811:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789672504.982776:0:5811:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789672504.982810:0:5811:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789672504.982828:0:5811:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789672505.049592:0:5865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789672505.049964:0:5865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789672505.049971:0:5865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789672505.587999:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672506.611035:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672507.635622:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672508.659956:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789672508.854654:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789672508.854662:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa604b25800 from 3 10000000:01000000:1.0:1789672508.854667:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672508.854712:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672508.854725:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672508.854736:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672508.854758:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e958613d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564254336:0@lo:101: 00000100:00100000:1.0:1789672508.854955:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672508.855046:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054d4422c going to sleep for 11 seconds 00000100:00100000:3.0:1789672508.855203:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254336 00000100:00100000:3.0:1789672508.855212:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254336 00000100:00100000:3.0:1789672508.855270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789672508.855279:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ff6109a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5827:x1876607564254336:12345-0@lo:101: 00010000:00010000:3.0:1789672508.855293:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672508.855306:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f864bbeb/0x2247cb9491d085ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d085c3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672508.855330:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f864bbeb/0x2247cb9491d085ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672508.855341:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f864bbeb/0x2247cb9491d085ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672508.855350:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f864bbeb, rc 0) 00000100:00100000:3.0:1789672508.855430:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ff6109a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564254336:12345-0@lo:101: Request processed in 151us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672508.855437:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672508.856715:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e958613d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564254336:0@lo:101: 00010000:00010000:1.0:1789672508.856737:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672508.856757:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672508.856841:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e958613d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564254464:0@lo:256: 00000100:00100000:1.0:1789672508.856892:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672508.856929:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054d4422c going to sleep for 11 seconds 00000100:00100000:3.0:1789672508.856990:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254464 00000100:00100000:3.0:1789672508.856997:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254464 00000100:00100000:3.0:1789672508.857042:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789672508.857050:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1084df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564254464:12345-0@lo:256: 20000000:01000000:3.0:1789672508.857068:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789672508.857083:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789672508.857086:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789672508.857164:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1084df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564254464:12345-0@lo:256: Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672508.857171:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672508.857239:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e958613d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564254464:0@lo:256: 10000000:01000000:1.0:1789672508.857280:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789672508.857285:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672508.857292:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: 00000000aaa0dffd/0x2247cb9491d085c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1789672509.353397:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789672509.683214:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672509.879628:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e958613d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564254592:0@lo:400: 00000100:00100000:3.0:1789672509.879703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672509.879875:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254592 00000100:00100000:2.0:1789672509.879884:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254592 00000100:00100000:2.0:1789672509.879932:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672509.879941:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7fc3784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3301:x1876607564254592:12345-0@lo:400: 00000100:00080000:1.0:1789672509.880025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789672509.880029:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789672509.880032:0:8:0:(import.c:65:import_set_state_nolock()) 00000000185db624 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789672509.880043:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000185db624 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672509.880065:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b59a3e51 x1876607564254720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789672509.880093:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b59a3e51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564254720:0@lo:38: 00000100:00100000:1.0:1789672509.880126:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672509.886945:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7fc3784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3301:x1876607564254592:12345-0@lo:400: Request processed in 6999us (7237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672509.886963:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672509.887114:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254720 00000100:00100000:2.0:1789672509.887123:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254720 00000100:00100000:2.0:1789672509.887155:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672509.887161:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fabdc3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1876607564254720:12345-0@lo:38: 00010000:00080000:2.0:1789672509.887185:0:5832:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1789672509.887240:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2247cb9491d085d1 00000004:00100000:2.0:1789672509.887278:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789672509.887460:0:5832:0:(import.c:65:import_set_state_nolock()) 000000004feca921 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672509.887534:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fabdc3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876607564254720:12345-0@lo:38: Request processed in 372us (7408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672509.887541:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789672509.887596:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b59a3e51 x1876607564254720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789672509.887907:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789672509.887915:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789672509.887920:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789672509.887922:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000185db624 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789672509.887928:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b59a3e51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564254720:0@lo:38: 00000100:00100000:3.0:1789672509.891364:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e958613d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564254592:0@lo:400: 00010000:00010000:1.0:1789672510.706971:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672511.731399:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672512.764597:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672513.780310:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789672514.306231:0:6310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe227c8970 20000000:00000080:3.0:1789672514.306252:0:6310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa6186c8000 uarg=0000000000000000 20000000:01000000:3.0:1789672514.306295:0:6310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789672514.306302:0:6310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789672514.306307:0:6310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789672514.308500:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789672514.308520:0:6310:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789672514.313362:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672514.314050:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789672514.314118:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789672514.314171:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789672514.314189:0:6310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789672514.314209:0:6310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672514.314228:0:6310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08592 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672514.314236:0:6310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672514.314285:0:6310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08592 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672514.314301:0:6310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08592 expref: 11 pid: 5824 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672514.314317:0:6310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000130b4085 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1876607564254848:0@lo:104: 00000100:00100000:3.0:1789672514.314383:0:6310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672514.314730:0:6310:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084f91720 going to sleep for 11 seconds 00000100:00100000:0.0:1789672514.315121:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254848 00000100:00100000:0.0:1789672514.315129:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254848 00000100:00100000:0.0:1789672514.315210:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672514.315219:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d04013e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:6310:x1876607564254848:12345-0@lo:104: 00010000:00010000:0.0:1789672514.315233:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672514.315307:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672514.315312:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d04013e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:6310:x1876607564254848:12345-0@lo:104: Request processed in 95us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672514.315318:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789672514.315365:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672514.315371:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315379:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c92860a3 already unused, calling callback (0000000079ce76aa) 10000000:00010000:2.0:1789672514.315381:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315398:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672514.315405:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672514.315410:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672514.315437:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315451:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672514.315469:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315475:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: 00000000c92860a3/0x2247cb9491d08592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08599 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315490:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672514.315491:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672514.315493:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672514.315503:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b574b147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564254976:0@lo:103: 00000100:00100000:2.0:1789672514.315532:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672514.315589:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564254976 00000100:00100000:2.0:1789672514.315593:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564254976 00010000:00010000:2.0:1789672514.315612:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08592 expref: 12 pid: 5824 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672514.315635:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672514.315640:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb0334aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3302:x1876607564254976:12345-0@lo:103: 00010000:00010000:2.0:1789672514.315650:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672514.315654:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08592 expref: 12 pid: 5824 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315662:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08592 expref: 12 pid: 5824 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315675:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315690:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315702:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315707:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315712:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315717:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315721:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061d60ce9 already unused, calling callback (000000008ff1ddda) 00010000:00010000:2.0:1789672514.315724:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315731:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315738:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672514.315747:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672514.315772:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb0334aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3302:x1876607564254976:12345-0@lo:103: Request processed in 133us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672514.315778:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672514.315836:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b574b147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564254976:0@lo:103: 00010000:00010000:1.0:1789672514.316005:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2c76179/0x2247cb9491d08599 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08592 expref: 11 pid: 5824 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672514.316027:0:6310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000130b4085 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1876607564254848:0@lo:104: 00010000:00010000:1.0:1789672514.316041:0:6310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672514.316049:0:6310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672514.316055:0:6310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672514.316059:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061d60ce9/0x2247cb9491d085d8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672514.805811:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672514.995074:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df7d4d44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564255104:0@lo:400: 00000100:00100000:0.0:1789672514.995152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672514.995268:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255104 00000100:00100000:2.0:1789672514.995278:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255104 00000100:00100000:2.0:1789672514.995334:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672514.995343:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028fc09d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564255104:12345-0@lo:400: 00000100:00100000:2.0:1789672514.996219:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028fc09d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564255104:12345-0@lo:400: Request processed in 875us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672514.996229:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789672514.996489:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000df7d4d44 x1876607564255104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672514.996504:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df7d4d44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564255104:0@lo:400: 00010000:00010000:2.0:1789672515.827025:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672516.854672:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789672516.981283:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672516.981292:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa604b25800 from 1 10000000:01000000:0.0:1789672516.981298:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672516.981354:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: 00000000661a194b/0x2247cb9491d085df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672516.981378:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: 00000000661a194b/0x2247cb9491d085df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672516.981388:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: 00000000661a194b/0x2247cb9491d085df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672516.981410:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005b279ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564255232:0@lo:101: 00000100:00100000:0.0:1789672516.981481:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672516.981526:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ff9e57b going to sleep for 11 seconds 00000100:00100000:0.0:1789672516.988461:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255232 00000100:00100000:0.0:1789672516.988481:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255232 00000100:00100000:0.0:1789672516.988543:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672516.988552:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aacc64ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:5827:x1876607564255232:12345-0@lo:101: 00010000:00010000:0.0:1789672516.988571:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672516.988592:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f33acad6/0x2247cb9491d085e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d085df expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672516.988618:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f33acad6/0x2247cb9491d085e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d085df expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672516.988630:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f33acad6/0x2247cb9491d085e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d085df expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672516.988649:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f33acad6, rc 0) 00000100:00100000:0.0:1789672516.988739:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aacc64ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564255232:12345-0@lo:101: Request processed in 188us (7258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672516.988747:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672516.988962:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005b279ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564255232:0@lo:101: 00010000:00010000:3.0:1789672516.988978:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: 00000000661a194b/0x2247cb9491d085df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672516.988987:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: 00000000661a194b/0x2247cb9491d085df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672516.989054:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032487910 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564255360:0@lo:501: 00000100:00100000:3.0:1789672516.989088:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672516.989135:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067e3f282 going to sleep for 11 seconds 00000100:00100000:0.0:1789672516.989183:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255360 00000100:00100000:0.0:1789672516.989188:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255360 00000100:00100000:0.0:1789672516.989211:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672516.989216:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc9f0af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564255360:12345-0@lo:501: 00000100:00100000:0.0:1789672516.989724:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc9f0af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564255360:12345-0@lo:501: Request processed in 506us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672516.989733:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672516.993293:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032487910 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564255360:0@lo:501: 00000100:00100000:3.0:1789672516.993637:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032487910 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564255488:0@lo:503: 00000100:00100000:3.0:1789672516.993715:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672516.993927:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067e3f282 going to sleep for 11 seconds 00000100:00100000:2.0:1789672516.994021:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255488 00000100:00100000:2.0:1789672516.994030:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255488 00000100:00100000:2.0:1789672516.994117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672516.994128:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030a26d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564255488:12345-0@lo:503: 00000100:00100000:2.0:1789672516.994859:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030a26d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564255488:12345-0@lo:503: Request processed in 640us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672516.994869:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672516.994971:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032487910 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564255488:0@lo:503: 00000100:00100000:1.0:1789672516.995405:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d291258 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6491:1876607564255616:0@lo:502: 00000100:00100000:1.0:1789672516.995453:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672516.995726:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1491924 going to sleep for 11 seconds 00000100:00100000:0.0:1789672516.995773:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255616 00000100:00100000:0.0:1789672516.995780:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255616 00000100:00100000:0.0:1789672516.995835:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672516.995842:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ee4053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6491:x1876607564255616:12345-0@lo:502: 00000100:00100000:0.0:1789672516.996015:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ee4053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6491:x1876607564255616:12345-0@lo:502: Request processed in 174us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672516.996023:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672516.996186:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d291258 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6491:1876607564255616:0@lo:502: 00000020:01000000:1.0:1789672516.996220:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672516.996228:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672516.996231:0:6491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789672516.996237:0:6491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa604b25800 00000020:00000080:1.0:1789672516.996239:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672516.996275:0:6491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6491:1876607564255744:0@lo:502: 00000100:00100000:1.0:1789672516.996309:0:6491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672516.996347:0:6491:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672516.996450:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255744 00000100:00100000:0.0:1789672516.996455:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255744 00000100:00100000:0.0:1789672516.996614:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672516.996624:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6491:x1876607564255744:12345-0@lo:502: 00000100:00100000:0.0:1789672516.996778:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6491:x1876607564255744:12345-0@lo:502: Request processed in 155us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672516.996809:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672516.996925:0:6491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6491:1876607564255744:0@lo:502: 00000020:01000000:3.0:1789672516.996948:0:6491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672516.996953:0:6491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672516.996954:0:6491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789672516.996958:0:6491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789672516.997022:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789672516.997038:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789672516.997047:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672516.997058:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672517.875134:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672518.900658:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672519.923951:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672520.115103:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564256000:0@lo:400: 00000100:00100000:2.0:1789672520.115231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672520.115310:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256000 00000100:00100000:2.0:1789672520.115318:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256000 00000100:00100000:2.0:1789672520.115375:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672520.115385:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564256000:12345-0@lo:400: 00000100:00100000:2.0:1789672520.115438:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564256000:12345-0@lo:400: Request processed in 55us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.115446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789672520.115488:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa608071f80 x1876607564256000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672520.115532:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564256000:0@lo:400: 00000100:00100000:3.0:1789672520.115655:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564255872:0@lo:400: 00000100:00100000:3.0:1789672520.115691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672520.117671:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564255872 00000100:00100000:2.0:1789672520.117684:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564255872 00000100:00100000:2.0:1789672520.117744:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789672520.117754:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3300:x1876607564255872:12345-0@lo:400: 00000100:00100000:2.0:1789672520.118642:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3300:x1876607564255872:12345-0@lo:400: Request processed in 887us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.118652:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789672520.118751:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564255872:0@lo:400: 00000020:01000004:2.0:1789672520.549626:0:6680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789672520.549630:0:6680:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789672520.549733:0:6680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa6117c1000 00000020:01000004:2.0:1789672520.549748:0:6680:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789672520.549760:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789672520.549772:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fa6103d99c0) 00000020:00000080:2.0:1789672520.549820:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789672520.562485:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789672520.563099:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789672520.580271:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789672520.585078:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789672520.585111:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789672520.585186:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789672520.585209:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789672520.585624:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789672520.585634:0:6680:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789672520.585643:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2247cb9491d085f4 00000020:01000004:2.0:1789672520.585651:0:6680:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789672520.585670:0:6680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789672520.585673:0:6680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789672520.585683:0:6680:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789672520.585688:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789672520.585704:0:6680:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fa62f1e3380) 00000020:00000080:2.0:1789672520.585713:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789672520.586992:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672520.587161:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789672520.587167:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789672520.593705:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789672520.593719:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789672520.595756:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789672520.595770:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789672520.597519:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672520.597699:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789672520.597705:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789672520.598316:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789672520.598324:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789672520.623315:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672520.623694:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789672520.623700:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789672520.625619:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789672520.625634:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789672520.627088:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789672520.627110:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789672520.630156:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672520.630681:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789672520.630688:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789672520.631323:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789672520.631339:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789672520.697200:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672520.697417:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789672520.697423:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789672520.700482:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789672520.700502:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789672520.701222:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789672520.701245:0:6680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789672520.701252:0:6680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789672520.734756:0:6680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789672520.734898:0:6680:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.139@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789672520.734902:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789672520.734904:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672520.734906:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672520.734907:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672520.734908:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672520.734909:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672520.734911:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672520.734912:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672520.734913:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672520.734915:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672520.734916:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672520.734920:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789672520.734922:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672520.734923:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672520.734924:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672520.734928:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672520.734929:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672520.734930:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672520.734931:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672520.734932:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672520.734933:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672520.734934:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672520.734935:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672520.734958:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789672520.734975:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564256128:0@lo:253: 00000100:00100000:2.0:1789672520.735036:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672520.735092:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602b4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672520.735816:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256128 00000100:00100000:3.0:1789672520.735833:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256128 00000100:00100000:3.0:1789672520.735889:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789672520.735898:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564256128:12345-0@lo:253: 20000000:01000000:3.0:1789672520.735931:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789672520.735936:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789672520.735941:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789672520.735944:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789672520.736938:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672520.737150:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789672520.737164:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789672520.737202:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789672520.737211:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789672520.737238:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789672520.737281:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789672520.737655:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789672520.737675:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.139@tcp 20000000:01000000:3.0:1789672520.737677:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.139@tcp (null) (null) (null) 00000040:00080000:3.0:1789672520.737710:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789672520.737717:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789672520.737771:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789672520.737779:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.139@tcp (null) (null) 00000040:00080000:3.0:1789672520.737840:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789672520.737851:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789672520.737883:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789672520.737932:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789672520.738639:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789672520.738656:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.139@tcp 20000000:01000000:3.0:1789672520.738658:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.139@tcp (null) (null) (null) 00000040:00080000:3.0:1789672520.738692:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789672520.738700:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789672520.738730:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789672520.738746:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.139@tcp (null) (null) 00000040:00080000:3.0:1789672520.738837:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789672520.738847:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789672520.738878:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789672520.738912:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789672520.738927:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789672520.738929:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789672520.738933:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789672520.738945:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789672520.738947:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789672520.738980:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789672520.738983:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789672520.739642:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789672520.740019:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789672520.740063:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789672520.740154:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789672520.740168:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789672520.740170:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672520.740648:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672520.740692:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672520.740741:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789672520.741025:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789672520.741065:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789672520.741117:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789672520.741130:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789672520.741132:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789672520.741555:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1789672520.741602:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1789672520.741651:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789672520.742140:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789672520.742181:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789672520.742213:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789672520.742227:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789672520.742229:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789672520.742239:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789672520.742260:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742279:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08514 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742288:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08530 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742307:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742316:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742364:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742379:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 12 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.742393:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564256256:0@lo:104: 00000100:00100000:3.0:1789672520.742465:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672520.742554:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08530 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742562:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08530 expref: 12 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.742571:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564256384:0@lo:104: 00000100:00100000:3.0:1789672520.742593:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672520.742665:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08514 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.742673:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08514 expref: 12 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.742681:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564256512:0@lo:104: 00000100:00100000:3.0:1789672520.742709:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.742760:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256256 00000100:00100000:0.0:1789672520.742769:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256256 00000100:00100000:0.0:1789672520.742832:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256384 00000100:00100000:0.0:1789672520.742835:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256384 00000100:00100000:0.0:1789672520.742851:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672520.742859:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:5825:x1876607564256256:12345-0@lo:104: 00010000:00010000:0.0:1789672520.742871:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.742920:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672520.742926:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:5825:x1876607564256256:12345-0@lo:104: Request processed in 68us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672520.742932:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672520.742948:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672520.742954:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564256384:12345-0@lo:104: 00010000:00010000:0.0:1789672520.742961:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.742992:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789672520.742996:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564256384:12345-0@lo:104: Request processed in 44us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672520.743001:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789672520.743018:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672520.743024:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743042:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee800 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672520.743046:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743055:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672520.743061:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672520.743067:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672520.743098:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743106:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672520.743125:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743133:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d085a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743146:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672520.743149:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743156:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421eec00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672520.743159:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743176:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672520.743183:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672520.743188:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672520.743200:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743206:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672520.743219:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743226:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421eec00/0x2247cb9491d08530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08537 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743235:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672520.743237:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672520.743239:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672520.743250:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564256640:0@lo:103: 00000100:00100000:0.0:1789672520.743276:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.743308:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256640 00000100:00100000:0.0:1789672520.743312:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256640 00010000:00010000:0.0:1789672520.743341:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 13 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672520.743363:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672520.743369:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3302:x1876607564256640:12345-0@lo:103: 00010000:00010000:0.0:1789672520.743387:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672520.743393:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 13 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743403:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 13 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.743417:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672520.743443:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3302:x1876607564256640:12345-0@lo:103: Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672520.743449:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672520.743484:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564256640:0@lo:103: 00010000:00010000:2.0:1789672520.743553:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672520.743747:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672520.743757:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564256768:0@lo:103: 00000100:00100000:3.0:1789672520.743781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.743835:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256768 00000100:00100000:3.0:1789672520.743840:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256768 00010000:00010000:3.0:1789672520.743859:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08530 expref: 13 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.743879:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672520.743885:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3300:x1876607564256768:12345-0@lo:103: 00010000:00010000:3.0:1789672520.743892:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672520.743896:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08530 expref: 13 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.743904:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08530 expref: 13 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.743916:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672520.743942:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3300:x1876607564256768:12345-0@lo:103: Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672520.743948:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672520.743970:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564256768:0@lo:103: 00000100:00100000:3.0:1789672520.743987:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0900 going to sleep for 11 seconds 00010000:00010000:3.0:1789672520.743997:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929e600/0x2247cb9491d085a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d085a0 expref: 12 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.744007:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564256256:0@lo:104: 00010000:00010000:3.0:1789672520.744015:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d08537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08530 expref: 11 pid: 5823 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.744030:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564256384:0@lo:104: 00000100:00100000:1.0:1789672520.744229:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256512 00000100:00100000:1.0:1789672520.744235:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256512 00000100:00100000:1.0:1789672520.744258:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672520.744264:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564256512:12345-0@lo:104: 00010000:00010000:1.0:1789672520.744273:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744324:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789672520.744339:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564256512:12345-0@lo:104: Request processed in 76us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.744344:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789672520.744362:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672520.744366:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744374:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f800 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672520.744377:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744385:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672520.744391:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672520.744407:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672520.744431:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744438:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672520.744450:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744457:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d08514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0851b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744472:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672520.744474:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672520.744476:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672520.744489:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564256896:0@lo:103: 00000100:00100000:1.0:1789672520.744515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.744549:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564256896 00000100:00100000:1.0:1789672520.744553:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564256896 00010000:00010000:1.0:1789672520.744566:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08514 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672520.744586:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672520.744593:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:3300:x1876607564256896:12345-0@lo:103: 00010000:00010000:1.0:1789672520.744600:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672520.744604:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08514 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744614:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08514 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744633:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744642:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744656:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744665:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744673:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744682:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744688:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672520.744693:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744702:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744711:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.744721:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672520.744748:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:3300:x1876607564256896:12345-0@lo:103: Request processed in 155us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.744762:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672520.744810:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564256896:0@lo:103: 00010000:00010000:3.0:1789672520.744984:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030000/0x2247cb9491d0851b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08514 expref: 10 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.744995:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564256512:0@lo:104: 00010000:00010000:3.0:1789672520.745013:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.745022:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.745028:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.745035:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d08602 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672520.745048:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789672520.792870:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:6680:x1876607564256128:12345-0@lo:253: Request processed in 56964us (57825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672520.792884:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789672520.793001:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564256128:0@lo:253: 10000000:01000000:2.0:1789672520.793016:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789672520.793019:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672520.793021:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672520.793022:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672520.793024:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789672520.793025:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672520.793027:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672520.793028:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672520.793030:0:6680:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789672520.793031:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672520.793033:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789672520.793125:0:6680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa6117c1000 from lustre-OST0000 10000000:01000000:3.0:1789672520.793152:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789672520.793156:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789672520.793163:0:6680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa6103db380 local copy 10000000:01000000:3.0:1789672520.793168:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789672520.793204:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.793236:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.793246:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.793264:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257024:0@lo:101: 00000100:00100000:3.0:1789672520.793299:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.793431:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.793502:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257024 00000100:00100000:2.0:1789672520.793577:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257024 00000100:00100000:2.0:1789672520.793620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672520.793638:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:6680:x1876607564257024:12345-0@lo:101: 00010000:00010000:2.0:1789672520.793651:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672520.793665:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08609 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.793685:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08609 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.793695:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08609 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.793703:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fc00, rc 0) 00000100:00100000:2.0:1789672520.793742:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:6680:x1876607564257024:12345-0@lo:101: Request processed in 107us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.793748:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789672520.793863:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257024:0@lo:101: 00010000:00010000:3.0:1789672520.793876:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.793885:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.793974:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257152:0@lo:501: 00000100:00100000:3.0:1789672520.793999:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672520.794056:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257152 00000100:00100000:2.0:1789672520.794060:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257152 00000100:00100000:2.0:1789672520.794090:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789672520.794096:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:6680:x1876607564257152:12345-0@lo:501: 00000100:00100000:2.0:1789672520.794279:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:6680:x1876607564257152:12345-0@lo:501: Request processed in 182us (278us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672520.794286:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789672520.794608:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672520.794624:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257152:0@lo:501: 10000000:01000000:3.0:1789672520.794639:0:6680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789672520.794668:0:6680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789672520.794674:0:6680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.794683:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.794697:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795025:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789672520.795048:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa6117c1000 10000000:01000000:3.0:1789672520.795053:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789672520.795057:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fa6103db380 10000000:01000000:3.0:1789672520.795060:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789672520.795063:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fa6103db380 from 1 10000000:01000000:3.0:1789672520.795066:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789672520.795089:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795098:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795109:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.795123:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257280:0@lo:101: 00000100:00100000:3.0:1789672520.795157:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.795229:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789672520.795322:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672520.795338:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.795346:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672520.795350:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.795370:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672520.795378:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672520.795385:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789672520.795465:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795473:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789672520.795598:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564257408:0@lo:103: 00000100:00100000:0.0:1789672520.795633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672520.795721:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795741:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2247cb9491d08610 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795757:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672520.795759:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672520.795761:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672520.795772:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257408 00000100:00100000:3.0:1789672520.795779:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257408 00000100:00100000:3.0:1789672520.795859:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672520.795868:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:3301:x1876607564257408:12345-0@lo:103: 00010000:00010000:3.0:1789672520.795880:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672520.795893:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08609 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.795907:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672520.795947:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:3301:x1876607564257408:12345-0@lo:103: Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672520.795954:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672520.796066:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564257408:0@lo:103: 00000100:00100000:1.0:1789672520.796133:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257280 00000100:00100000:1.0:1789672520.796138:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257280 00000100:00100000:0.0:1789672520.796274:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789672520.796282:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:6680:x1876607564257280:12345-0@lo:101: 00010000:00010000:0.0:1789672520.796293:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672520.796307:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031000/0x2247cb9491d0861e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08617 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.796335:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031000/0x2247cb9491d0861e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08617 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.796347:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031000/0x2247cb9491d0861e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08617 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.796354:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031000, rc 0) 00000100:00100000:0.0:1789672520.796391:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:6680:x1876607564257280:12345-0@lo:101: Request processed in 110us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672520.796403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789672520.796460:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257280:0@lo:101: 00010000:00010000:3.0:1789672520.796473:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.796482:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672520.796499:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789672520.796521:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.796535:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672520.796544:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789672520.796548:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789672520.796553:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789672520.796555:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789672520.796571:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.796580:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.796588:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.796600:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257536:0@lo:101: 00000100:00100000:3.0:1789672520.796625:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.796835:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.796916:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257536 00000100:00100000:2.0:1789672520.796922:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257536 00000100:00100000:2.0:1789672520.796944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789672520.796950:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+10:6680:x1876607564257536:12345-0@lo:101: 00010000:00010000:2.0:1789672520.796956:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672520.796965:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08625 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.796978:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08625 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.796985:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08625 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.796992:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929e200, rc 0) 00000100:00100000:2.0:1789672520.797029:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257536:12345-0@lo:101: Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.797034:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672520.797097:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257536:0@lo:101: 00010000:00010000:3.0:1789672520.797108:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.797116:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672520.797198:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257664:0@lo:501: 00000100:00100000:3.0:1789672520.797246:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.797266:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.797312:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257664 00000100:00100000:2.0:1789672520.797317:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257664 00000100:00100000:2.0:1789672520.797351:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672520.797357:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257664:12345-0@lo:501: 00000100:00100000:2.0:1789672520.797591:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257664:12345-0@lo:501: Request processed in 233us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.797598:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789672520.797724:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257664:0@lo:501: 00000100:00100000:3.0:1789672520.797752:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257792:0@lo:503: 00000100:00100000:3.0:1789672520.797823:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.797844:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.798118:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257792 00000100:00100000:2.0:1789672520.798124:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257792 00000100:00100000:2.0:1789672520.798141:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672520.798146:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257792:12345-0@lo:503: 00000100:00100000:2.0:1789672520.798287:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257792:12345-0@lo:503: Request processed in 139us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.798294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672520.798375:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257792:0@lo:503: 00000040:00080000:3.0:1789672520.798694:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789672520.798763:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257920:0@lo:502: 00000100:00100000:3.0:1789672520.798851:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.798877:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.799125:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564257920 00000100:00100000:2.0:1789672520.799131:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564257920 00000100:00100000:2.0:1789672520.799155:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789672520.799161:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257920:12345-0@lo:502: 00000100:00100000:2.0:1789672520.799319:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564257920:12345-0@lo:502: Request processed in 156us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.799335:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789672520.799415:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564257920:0@lo:502: 00000040:00080000:3.0:1789672520.799756:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789672520.799848:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789672520.799886:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789672520.799947:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789672520.799983:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789672520.800014:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789672520.800044:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258048:0@lo:502: 00000100:00100000:3.0:1789672520.800084:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672520.800109:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672520.800191:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258048 00000100:00100000:0.0:1789672520.800197:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258048 00000100:00100000:0.0:1789672520.800227:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789672520.800234:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564258048:12345-0@lo:502: 00000100:00100000:0.0:1789672520.800385:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564258048:12345-0@lo:502: Request processed in 151us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672520.800392:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672520.800680:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258048:0@lo:502: 00000040:00080000:3.0:1789672520.800762:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789672520.800774:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789672520.801293:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789672520.801301:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789672520.801314:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672520.801316:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789672520.801321:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672520.801346:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fa63a3acd40) 00000020:00000080:3.0:1789672520.801364:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789672520.801370:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789672520.801437:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa6117c1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789672520.801444:0:6699:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789672520.801451:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2247cb9491d0863a 00010000:00010000:3.0:1789672520.806030:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789672520.806402:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789672520.808742:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789672520.809035:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789672520.823028:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789672520.823440:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789672520.825151:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789672520.825161:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672520.825167:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672520.825169:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789672520.825174:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672520.825178:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672520.825179:0:6699:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789672520.825182:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789672520.825184:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789672520.825230:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672520.825232:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672520.825233:0:6699:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789672520.825236:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789672520.828570:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789672520.828614:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789672520.828639:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.828653:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672520.828662:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6117c1000 from 1 10000000:01000000:1.0:1789672520.828665:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672520.828709:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.828722:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.828734:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672520.828757:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258176:0@lo:101: 00000100:00100000:1.0:1789672520.828889:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.828933:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.828934:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258176 00000100:00100000:2.0:1789672520.828943:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258176 00000100:00100000:2.0:1789672520.828985:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789672520.828994:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:6680:x1876607564258176:12345-0@lo:101: 00010000:00010000:2.0:1789672520.829008:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672520.829021:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08641 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.829042:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08641 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.829063:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08641 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.829071:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fc00, rc 0) 00000100:00100000:2.0:1789672520.829121:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258176:12345-0@lo:101: Request processed in 128us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.829128:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789672520.829288:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258176:0@lo:101: 00010000:00010000:1.0:1789672520.829302:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.829317:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672520.829450:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258304:0@lo:501: 00000100:00100000:1.0:1789672520.829474:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.829497:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.829598:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258304 00000100:00100000:2.0:1789672520.829603:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258304 00000100:00100000:2.0:1789672520.829636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672520.829643:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258304:12345-0@lo:501: 00000100:00100000:2.0:1789672520.829894:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258304:12345-0@lo:501: Request processed in 250us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.829900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789672520.830183:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258304:0@lo:501: 00000100:00100000:1.0:1789672520.830215:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258432:0@lo:503: 00000100:00100000:1.0:1789672520.830252:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.830273:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.830324:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258432 00000100:00100000:2.0:1789672520.830339:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258432 00000100:00100000:2.0:1789672520.830370:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672520.830377:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258432:12345-0@lo:503: 00000100:00100000:2.0:1789672520.830639:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258432:12345-0@lo:503: Request processed in 261us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.830646:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789672520.830898:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258432:0@lo:503: 00000040:00080000:1.0:1789672520.831204:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672520.831274:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258560:0@lo:502: 00000100:00100000:1.0:1789672520.831314:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.831350:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6098b9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.832027:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258560 00000100:00100000:2.0:1789672520.832034:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258560 00000100:00100000:2.0:1789672520.832083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672520.832092:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258560:12345-0@lo:502: 00000100:00100000:2.0:1789672520.832301:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258560:12345-0@lo:502: Request processed in 210us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.832315:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789672520.832467:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258560:0@lo:502: 00000040:00080000:1.0:1789672520.832723:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789672520.832769:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789672520.832830:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258688:0@lo:502: 00000100:00100000:1.0:1789672520.832875:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.832911:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672520.832926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258688 00000100:00100000:1.0:1789672520.832931:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258688 00000100:00100000:1.0:1789672520.832957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789672520.832963:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258688:12345-0@lo:502: 00000100:00100000:1.0:1789672520.833093:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258688:12345-0@lo:502: Request processed in 130us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.833100:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789672520.833134:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258688:0@lo:502: 00000040:00080000:1.0:1789672520.833203:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789672520.833213:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789672520.837578:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672520.837592:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672520.837594:0:6704:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789672520.837602:0:6704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa6117c1000 00000020:00000080:0.0:1789672520.837605:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789672520.837627:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672520.837629:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672520.837631:0:6704:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789672520.837634:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789672520.837818:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789672520.837847:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672520.837872:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.837886:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672520.838171:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789672520.838176:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa6117c1000 10000000:01000000:0.0:1789672520.838180:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa6117c1000 10000000:01000000:0.0:1789672520.838185:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789672520.838191:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa6117c1000 from 1 10000000:01000000:0.0:1789672520.838194:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789672520.838245:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.838255:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.838269:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672520.838320:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258816:0@lo:101: 00000100:00100000:0.0:1789672520.838408:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.838452:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608bdb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672520.838592:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258816 00000100:00100000:1.0:1789672520.838599:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258816 00000100:00100000:1.0:1789672520.838648:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789672520.838658:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564258816:12345-0@lo:101: 00010000:00010000:1.0:1789672520.838671:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672520.838684:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0864f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.838708:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0864f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.838719:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0864f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.838728:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f3600, rc 0) 00000100:00100000:1.0:1789672520.838819:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564258816:12345-0@lo:101: Request processed in 161us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.838825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789672520.838882:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258816:0@lo:101: 00010000:00010000:0.0:1789672520.838896:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.838905:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672520.839002:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258944:0@lo:501: 00000100:00100000:0.0:1789672520.839028:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.839053:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608bdb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.839203:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564258944 00000100:00100000:2.0:1789672520.839208:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564258944 00000100:00100000:2.0:1789672520.839245:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789672520.839251:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564258944:12345-0@lo:501: 00000100:00100000:2.0:1789672520.839959:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564258944:12345-0@lo:501: Request processed in 533us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.839967:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789672520.840917:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564258944:0@lo:501: 00000100:00100000:0.0:1789672520.840959:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259072:0@lo:503: 00000100:00100000:0.0:1789672520.841010:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.841052:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608bdb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.841236:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259072 00000100:00100000:2.0:1789672520.841243:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259072 00000100:00100000:2.0:1789672520.841288:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789672520.841297:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259072:12345-0@lo:503: 00000100:00100000:2.0:1789672520.841478:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259072:12345-0@lo:503: Request processed in 181us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.841485:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789672520.841664:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259072:0@lo:503: 00000040:00080000:0.0:1789672520.842082:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789672520.842149:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259200:0@lo:502: 00000100:00100000:0.0:1789672520.842188:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.842215:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608bdb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672520.842277:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259200 00000100:00100000:1.0:1789672520.842282:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259200 00000100:00100000:1.0:1789672520.842312:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672520.842318:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259200:12345-0@lo:502: 00000100:00100000:1.0:1789672520.842496:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259200:12345-0@lo:502: Request processed in 177us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.842503:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789672520.843589:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259200:0@lo:502: 00000040:00080000:0.0:1789672520.843875:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789672520.844242:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789672520.844278:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789672520.844336:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789672520.844372:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789672520.844481:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789672520.844516:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789672520.844546:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789672520.844591:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789672520.844622:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789672520.844650:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789672520.844709:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789672520.844741:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789672520.844768:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789672520.844832:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789672520.845077:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789672520.845107:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789672520.845150:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789672520.845182:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789672520.845210:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789672520.845254:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789672520.845288:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789672520.845321:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789672520.845563:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789672520.845605:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789672520.845640:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789672520.845690:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789672520.845744:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789672520.845816:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259328:0@lo:502: 00000100:00100000:0.0:1789672520.846493:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.846620:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608bdb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672520.847804:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259328 00000100:00100000:1.0:1789672520.847816:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259328 00000100:00100000:1.0:1789672520.847877:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789672520.847887:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259328:12345-0@lo:502: 00000100:00100000:1.0:1789672520.848163:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259328:12345-0@lo:502: Request processed in 278us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.848172:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789672520.848364:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259328:0@lo:502: 00000040:00080000:0.0:1789672520.848650:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789672520.848674:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789672520.849318:0:6705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789672520.849345:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fa62f1e0000) 00000020:00000080:2.0:1789672520.849365:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789672520.849659:0:6705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa6117c1000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789672520.849664:0:6705:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa6117c1000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789672520.849667:0:6705:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa6117c1000 3 00010000:00080000:2.0:1789672520.849697:0:6705:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa63fb96000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.139@tcp at head 00010000:00010000:2.0:1789672520.854184:0:6705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789672520.854467:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789672520.854593:0:6705:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789672520.854609:0:6705:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2247cb9491d08664 00000100:00080000:2.0:1789672520.854621:0:6705:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672520.854638:0:6705:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa63fb96000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:2.0:1789672520.854676:0:6705:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa608071f80 x1876607564259456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672520.854707:0:6705:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789672520.854867:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672520.854881:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564259584:0@lo:400: 00000100:00100000:0.0:1789672520.854944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.855009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259584 00000100:00100000:0.0:1789672520.855016:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259584 00000100:00100000:0.0:1789672520.855058:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672520.855065:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564259584:12345-0@lo:400: 00000100:00100000:0.0:1789672520.855115:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564259584:12345-0@lo:400: Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672520.855123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789672520.855159:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa639e17480 x1876607564259584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672520.855172:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564259584:0@lo:400: 00000100:00100000:3.0:1789672520.856296:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1876607564259456:0@lo:38: 00000100:00100000:3.0:1789672520.856364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672520.856440:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259456 00000100:00100000:2.0:1789672520.856447:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259456 00000100:00100000:2.0:1789672520.856480:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672520.856487:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1876607564259456:12345-0@lo:38: 00010000:00080000:2.0:1789672520.856625:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1789672520.856657:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2247cb9491d0866b 00000004:00100000:2.0:1789672520.856671:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789672520.856705:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb93800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1789672520.858124:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1789672520.858613:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876607564259456:12345-0@lo:38: Request processed in 2121us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.858623:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789672520.859157:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa608071f80 x1876607564259456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672520.859182:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789672520.859191:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789672520.859199:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789672520.859204:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789672520.859207:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb96000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789672520.859214:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1876607564259456:0@lo:38: 00000020:01000000:0.0:1789672520.859916:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789672520.859948:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672520.859968:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.859980:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789672520.860026:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789672520.860028:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789672520.860029:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672520.860031:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672520.860032:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672520.860034:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672520.860035:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672520.860037:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672520.860042:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672520.860043:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672520.860044:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789672520.860047:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789672520.860048:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789672520.860049:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789672520.860050:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672520.860050:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672520.860051:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672520.860052:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672520.860052:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672520.860053:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672520.860053:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672520.860054:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672520.860055:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789672520.860073:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789672520.860084:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259712:0@lo:253: 00000100:00100000:0.0:1789672520.860130:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.860155:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608bdb300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672520.861522:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259712 00000100:00100000:1.0:1789672520.861532:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259712 00000100:00100000:1.0:1789672520.861579:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672520.861589:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6680:x1876607564259712:12345-0@lo:253: 20000000:01000000:1.0:1789672520.861620:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789672520.861634:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789672520.890591:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789672520.890612:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789672520.890706:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789672520.890712:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789672520.890738:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.890758:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.890767:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.890980:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672520.890995:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 13 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672520.891034:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876607564259840:0@lo:104: 00000100:00100000:0.0:1789672520.891100:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672520.891168:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602dd10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672520.891482:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259840 00000100:00100000:2.0:1789672520.891492:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259840 00000100:00100000:2.0:1789672520.891555:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672520.891566:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5846:x1876607564259840:12345-0@lo:104: 00010000:00010000:2.0:1789672520.891580:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672520.891651:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672520.891657:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5846:x1876607564259840:12345-0@lo:104: Request processed in 94us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672520.891664:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789672520.891745:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876607564259840:0@lo:104: 00010000:00010000:3.0:1789672520.891766:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.891770:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672520.891776:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.891825:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f2200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672520.891830:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.891838:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672520.891845:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672520.891851:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672520.891886:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.891892:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672520.891908:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.891914:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d085c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.891932:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672520.891934:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672520.891936:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672520.891952:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564259968:0@lo:103: 00000100:00100000:1.0:1789672520.892004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672520.892058:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564259968 00000100:00100000:1.0:1789672520.892063:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564259968 00010000:00010000:1.0:1789672520.892081:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 14 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672520.892116:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672520.892123:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:3299:x1876607564259968:12345-0@lo:103: 00010000:00010000:1.0:1789672520.892134:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672520.892139:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 14 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892150:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 14 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892162:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421ef000/0x2247cb9491d085ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d085c3 expref: 14 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892180:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892188:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789672520.892202:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005495827s 00010000:00010000:1.0:1789672520.892206:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892213:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892220:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892227:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892240:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672520.892244:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892251:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892267:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672520.892277:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672520.892293:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.892301:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672520.892308:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030000/0x2247cb9491d08672 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672520.892314:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3299:x1876607564259968:12345-0@lo:103: Request processed in 192us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.892320:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672520.892362:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564259968:0@lo:103: 00000100:00100000:1.0:1789672520.900631:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:6680:x1876607564259712:12345-0@lo:253: Request processed in 39034us (40489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672520.900646:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789672520.900748:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:6680:1876607564259712:0@lo:253: 10000000:01000000:0.0:1789672520.900764:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789672520.900768:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789672520.900770:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789672520.900771:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672520.901103:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672520.901106:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672520.901108:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672520.901109:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672520.901110:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672520.901112:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672520.901113:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672520.901115:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789672520.901131:0:6680:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789672520.907281:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789672520.907498:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789672520.907718:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672520.908133:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789672520.908347:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672520.908569:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789672520.910346:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789672520.947213:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789672521.101357:0:6680:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789672521.101373:0:6680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789672521.101408:0:6680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789672521.101466:0:6680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789672521.101480:0:6680:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789672521.101521:0:6680:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789672521.970923:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672522.997331:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789672523.314856:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789672523.314864:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa604b25800 from 21 10000000:01000000:3.0:1789672523.314870:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672523.314916:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672523.314927:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672523.314951:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672523.314974:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260096:0@lo:101: 00000100:00100000:3.0:1789672523.315058:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672523.315117:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672523.315281:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260096 00000100:00100000:2.0:1789672523.315289:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260096 00000100:00100000:2.0:1789672523.315362:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789672523.315371:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564260096:12345-0@lo:101: 00010000:00010000:2.0:1789672523.315393:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672523.315406:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08679 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672523.315429:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08679 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672523.315440:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08679 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672523.315450:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ee00, rc 0) 00000100:00100000:2.0:1789672523.315500:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564260096:12345-0@lo:101: Request processed in 130us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.315506:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789672523.315678:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260096:0@lo:101: 00010000:00010000:3.0:1789672523.315692:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672523.315701:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672523.315753:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260224:0@lo:501: 00000100:00100000:3.0:1789672523.315780:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672523.315853:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672523.315942:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260224 00000100:00100000:1.0:1789672523.315947:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260224 00000100:00100000:1.0:1789672523.315976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789672523.315984:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564260224:12345-0@lo:501: 00000100:00100000:1.0:1789672523.316384:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564260224:12345-0@lo:501: Request processed in 400us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672523.316392:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789672523.316594:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260224:0@lo:501: 00000100:00100000:3.0:1789672523.316626:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260352:0@lo:503: 00000100:00100000:3.0:1789672523.316666:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672523.316692:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672523.316744:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260352 00000100:00100000:1.0:1789672523.316749:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260352 00000100:00100000:1.0:1789672523.316782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789672523.316821:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564260352:12345-0@lo:503: 00000100:00100000:1.0:1789672523.317391:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564260352:12345-0@lo:503: Request processed in 569us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672523.317399:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789672523.321543:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260352:0@lo:503: 00000100:00100000:1.0:1789672523.336422:0:6828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6828:1876607564260480:0@lo:502: 00000100:00100000:1.0:1789672523.336509:0:6828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.338599:0:6828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610322b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672523.341244:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260480 00000100:00100000:2.0:1789672523.341259:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260480 00000100:00100000:2.0:1789672523.341373:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789672523.341384:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6828:x1876607564260480:12345-0@lo:502: 00000100:00100000:2.0:1789672523.341743:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6828:x1876607564260480:12345-0@lo:502: Request processed in 360us (5234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.341751:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789672523.343362:0:6828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6828:1876607564260480:0@lo:502: 00000100:00100000:0.0:1789672523.343452:0:6828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6828:1876607564260608:0@lo:502: 00000100:00100000:0.0:1789672523.343523:0:6828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.353670:0:6828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672523.354168:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260608 00000100:00100000:1.0:1789672523.354179:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260608 00000100:00100000:1.0:1789672523.354232:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789672523.354243:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6828:x1876607564260608:12345-0@lo:502: 00000100:00100000:1.0:1789672523.355216:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:6828:x1876607564260608:12345-0@lo:502: Request processed in 971us (11690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672523.355226:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789672523.355356:0:6828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6828:1876607564260608:0@lo:502: 00000040:00080000:0.0:1789672523.355399:0:6828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789672523.355662:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789672523.355682:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789672523.355693:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.355705:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672523.355724:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789672523.355726:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa604b25800 from 4 10000000:01000000:1.0:1789672523.355729:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672523.355760:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.355769:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.355778:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672523.355826:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260736:0@lo:101: 00000100:00100000:1.0:1789672523.355864:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.356007:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610322d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.356068:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260736 00000100:00100000:0.0:1789672523.356080:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260736 00000100:00100000:0.0:1789672523.356111:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789672523.356118:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564260736:12345-0@lo:101: 00010000:00010000:0.0:1789672523.356129:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672523.356142:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08687 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.356165:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08687 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.356176:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08687 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.356184:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600030c00, rc 0) 00000100:00100000:0.0:1789672523.356229:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564260736:12345-0@lo:101: Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.356234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789672523.356620:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260736:0@lo:101: 00010000:00010000:1.0:1789672523.356634:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.356642:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672523.356689:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260864:0@lo:256: 00000100:00100000:1.0:1789672523.356723:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.356746:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610322d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.356810:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260864 00000100:00100000:0.0:1789672523.356815:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260864 00000100:00100000:0.0:1789672523.356834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789672523.356840:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564260864:12345-0@lo:256: 20000000:01000000:0.0:1789672523.356853:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789672523.356871:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789672523.356874:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789672523.357011:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564260864:12345-0@lo:256: Request processed in 170us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.357018:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789672523.358190:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260864:0@lo:256: 10000000:01000000:1.0:1789672523.358239:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789672523.358252:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.358263:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672523.358272:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789672523.358274:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789672523.358277:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789672523.358312:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.358321:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672523.358330:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672523.358345:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260992:0@lo:101: 00000100:00100000:1.0:1789672523.358383:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.358416:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b9a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.358587:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564260992 00000100:00100000:0.0:1789672523.358593:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564260992 00000100:00100000:0.0:1789672523.358643:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789672523.358651:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564260992:12345-0@lo:101: 00010000:00010000:0.0:1789672523.358662:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672523.358674:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08695 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.358693:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08695 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.358702:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08695 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.358709:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031a00, rc 0) 00000100:00100000:0.0:1789672523.358739:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564260992:12345-0@lo:101: Request processed in 89us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.358745:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789672523.358925:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564260992:0@lo:101: 00010000:00010000:0.0:1789672523.358937:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.358946:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672523.358993:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261120:0@lo:501: 00000100:00100000:0.0:1789672523.359017:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.359045:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672523.359111:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261120 00000100:00100000:2.0:1789672523.359116:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261120 00000100:00100000:2.0:1789672523.359149:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789672523.359157:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564261120:12345-0@lo:501: 00000100:00100000:2.0:1789672523.359391:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564261120:12345-0@lo:501: Request processed in 235us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.359398:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789672523.360935:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261120:0@lo:501: 00000100:00100000:0.0:1789672523.360980:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261248:0@lo:503: 00000100:00100000:0.0:1789672523.361102:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.361140:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.361158:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261248 00000100:00100000:0.0:1789672523.361163:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261248 00000100:00100000:0.0:1789672523.361199:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789672523.361206:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564261248:12345-0@lo:503: 00000100:00100000:0.0:1789672523.361554:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564261248:12345-0@lo:503: Request processed in 348us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.361561:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789672523.361609:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261248:0@lo:503: 00000100:00100000:2.0:1789672523.370040:0:6831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6831:1876607564261376:0@lo:502: 00000100:00100000:2.0:1789672523.370129:0:6831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672523.370345:0:6831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.371154:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261376 00000100:00100000:0.0:1789672523.371164:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261376 00000100:00100000:0.0:1789672523.372150:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789672523.372164:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:6831:x1876607564261376:12345-0@lo:502: 00000100:00100000:0.0:1789672523.372515:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:6831:x1876607564261376:12345-0@lo:502: Request processed in 354us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.372523:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789672523.372600:0:6831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6831:1876607564261376:0@lo:502: 00000020:01000000:3.0:1789672523.372634:0:6831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789672523.372641:0:6831:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789672523.372652:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672523.372655:0:6831:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789672523.372661:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789672523.372665:0:6831:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.139@tcp to nid 0x20000c0a8ca8b (192.168.202.139@tcp) 00000020:01000000:3.0:1789672523.372689:0:6831:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789672523.372692:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672523.372705:0:6831:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fa63a3a99c0) 00000020:00000080:3.0:1789672523.372723:0:6831:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789672523.372728:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789672523.372827:0:6831:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789672523.372832:0:6831:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789672523.372839:0:6831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d086aa 00010000:00080000:3.0:1789672523.372865:0:6831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa63f8ca800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.139@tcp at head 00010000:00010000:3.0:1789672523.373081:0:6831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789672523.407187:0:6831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789672523.407210:0:6831:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789672523.407759:0:6831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672523.407927:0:6831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672523.407973:0:6831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789672523.408021:0:6831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789672523.409026:0:6834:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672523.409031:0:6834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789672523.409628:0:6831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789672523.409640:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789672523.409673:0:6831:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789672523.409695:0:6831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d086b1 00000100:00080000:0.0:1789672523.409706:0:6831:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789672523.409718:0:6831:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa63f8ca800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:0.0:1789672523.409754:0:6831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa639e17480 x1876607564261504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789672523.409782:0:6831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789672523.409871:0:6831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672523.409883:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672523.409885:0:6831:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789672523.409889:0:6831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672523.409892:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672523.409893:0:6831:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789672523.409896:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789672523.409899:0:6831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789672523.409926:0:6831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6831:1876607564261632:0@lo:502: 00000100:00100000:0.0:1789672523.410002:0:6831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.410044:0:6831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60cb8e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.410066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261632 00000100:00100000:0.0:1789672523.410071:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261632 00000100:00100000:0.0:1789672523.410104:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789672523.410114:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:6831:x1876607564261632:12345-0@lo:502: 00000100:00100000:0.0:1789672523.410324:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:6831:x1876607564261632:12345-0@lo:502: Request processed in 211us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.410332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789672523.410383:0:6831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:6831:1876607564261632:0@lo:502: 00000020:01000000:0.0:1789672523.410406:0:6831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672523.410410:0:6831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672523.410411:0:6831:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789672523.410415:0:6831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789672523.410514:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789672523.410532:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789672523.410543:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410554:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672523.410575:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789672523.410577:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa6103db380 from 1 10000000:01000000:0.0:1789672523.410580:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789672523.410605:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410613:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410622:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672523.410633:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261760:0@lo:101: 00000100:00100000:0.0:1789672523.410659:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.410675:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60cb8e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.410690:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261760 00000100:00100000:0.0:1789672523.410694:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261760 00000100:00100000:0.0:1789672523.410719:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672523.410725:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564261760:12345-0@lo:101: 00010000:00010000:0.0:1789672523.410733:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672523.410744:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d086b8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410765:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410775:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410820:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031c00, rc 0) 00000100:00100000:0.0:1789672523.410851:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564261760:12345-0@lo:101: Request processed in 126us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672523.410857:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672523.410886:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261760:0@lo:101: 00010000:00010000:0.0:1789672523.410897:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.410906:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672523.410944:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261888:0@lo:501: 00000100:00100000:0.0:1789672523.410966:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.410979:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60cb8e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.410990:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261888 00000100:00100000:0.0:1789672523.410993:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261888 00000100:00100000:0.0:1789672523.411011:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789672523.411017:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564261888:12345-0@lo:501: 00000100:00100000:0.0:1789672523.411219:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564261888:12345-0@lo:501: Request processed in 201us (251us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672523.411226:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789672523.411256:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564261888:0@lo:501: 10000000:01000000:0.0:1789672523.411274:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789672523.411279:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672523.411298:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672523.411477:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672523.411488:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564262016:0@lo:400: 00000100:00100000:2.0:1789672523.411518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672523.411550:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564262144:0@lo:400: 00000100:00100000:2.0:1789672523.411576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672523.411611:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262016 00000100:00100000:2.0:1789672523.411615:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262016 00000100:00100000:2.0:1789672523.411640:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262144 00000100:00100000:2.0:1789672523.411643:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262144 00000100:00100000:2.0:1789672523.411667:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672523.411674:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564262016:12345-0@lo:400: 00000100:00100000:2.0:1789672523.411711:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564262016:12345-0@lo:400: Request processed in 37us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.411717:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672523.411729:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672523.411734:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564262144:12345-0@lo:400: 00000100:00100000:2.0:1789672523.411759:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564262144:12345-0@lo:400: Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.411770:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789672523.411814:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789672523.411849:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa608071180 x1876607564262144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672523.411860:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564262144:0@lo:400: 00010000:00080000:2.0:1789672523.411883:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa608073800 x1876607564262016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672523.411891:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564262016:0@lo:400: 00000100:00100000:3.0:1789672523.412113:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564261504:0@lo:8: 00000100:00100000:3.0:1789672523.412151:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672523.412280:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564261504 00000100:00100000:2.0:1789672523.412285:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564261504 00000100:00100000:2.0:1789672523.412324:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672523.412329:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1876607564261504:12345-0@lo:8: 00010000:00080000:2.0:1789672523.412351:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1789672523.412379:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d086c6 00002000:00100000:2.0:1789672523.412420:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fa63fb95800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789672523.412425:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789672523.412429:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789672523.412562:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789672523.412702:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789672523.412724:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672523.412768:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876607564261504:12345-0@lo:8: Request processed in 436us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.412775:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789672523.412854:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639e17480 x1876607564261504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672523.412876:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789672523.412883:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789672523.412890:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789672523.412896:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789672523.412898:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa63f8ca800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789672523.412911:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789672523.412916:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564261504:0@lo:8: 00000004:00080000:2.0:1789672523.413008:0:6834:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789672523.413099:0:6834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 192194312662ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789672523.464994:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789672523.497809:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564262272:0@lo:13: 00000100:00100000:1.0:1789672523.497883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.497966:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262272 00000100:00100000:1.0:1789672523.497975:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262272 00000100:00100000:1.0:1789672523.498029:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672523.498039:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564262272:12345-0@lo:13: 00002000:00000024:1.0:1789672523.498069:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789672523.498115:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564262272:12345-0@lo:13: Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672523.498130:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789672523.498152:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672523.498177:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4e680 x1876607564262272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672523.498195:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564262272:0@lo:13: 00000004:00080000:1.0:1789672523.498211:0:6835:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789672523.498228:0:6835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262400:0@lo:7: 00000100:00100000:1.0:1789672523.498250:0:6835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.498266:0:6835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672523.498445:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262400 00000100:00100000:3.0:1789672523.498449:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262400 00000100:00100000:3.0:1789672523.498568:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672523.498575:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6835:x1876607564262400:12345-0@lo:7: 00002000:00080000:3.0:1789672523.506550:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789672523.506558:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789672523.506655:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6835:x1876607564262400:12345-0@lo:7: Request processed in 8077us (8399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672523.506665:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789672523.507031:0:6835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4e680 x1876607564262400/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789672539 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672523.507046:0:6835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262400:0@lo:7: 00000004:00080000:3.0:1789672523.507059:0:6835:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789672523.507096:0:6835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262528:0@lo:5: 00000100:00100000:3.0:1789672523.507130:0:6835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672523.507206:0:6835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672523.507248:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262528 00000100:00100000:0.0:1789672523.507256:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262528 00000100:00100000:0.0:1789672523.507336:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672523.507346:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6835:x1876607564262528:12345-0@lo:5: 00002000:00080000:0.0:1789672523.507370:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789672523.507374:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789672523.507712:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6835:x1876607564262528:12345-0@lo:5: Request processed in 366us (580us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789672523.507718:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789672523.507771:0:6835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa641b33800 x1876607564262528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672539 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672523.507813:0:6835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262528:0@lo:5: 00000004:00080000:3.0:1789672523.507823:0:6835:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789672523.507845:0:6835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262656:0@lo:700: 00000100:00100000:3.0:1789672523.507867:0:6835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672523.507884:0:6835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672523.507944:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262656 00000100:00100000:1.0:1789672523.507949:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262656 00000100:00100000:1.0:1789672523.507980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672523.507987:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6835:x1876607564262656:12345-0@lo:700: 00000100:00100000:1.0:1789672523.508011:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876607564262784:0@lo:700: 00000100:00100000:1.0:1789672523.508040:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672523.508059:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672523.508091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262784 00000100:00100000:1.0:1789672523.508094:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262784 00000100:00100000:1.0:1789672523.508120:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672523.508127:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876607564262784:12345-0@lo:700: 40000000:02000000:1.0:1789672523.538141:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789672523.546199:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1876607564262784:12345-0@lo:700: Request processed in 38065us (38150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672523.546214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789672523.546368:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4d880 x1876607564262784/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789672539 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672523.546384:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1876607564262784:0@lo:700: 40000000:02000000:0.0:1789672523.546396:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789672523.658111:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789672523.658279:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789672523.658911:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6835:x1876607564262656:12345-0@lo:700: Request processed in 150919us (151037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672523.658930:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789672523.659110:0:6835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa641b31880 x1876607564262656/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789672539 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672523.659123:0:6835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789672523.659142:0:6835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262656:0@lo:700: 00000004:02000040:1.0:1789672523.705307:0:6835:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789672523.711402:0:6835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262912:0@lo:5: 00000100:00100000:0.0:1789672523.711484:0:6835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672523.711768:0:6835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608283480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672523.712224:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564262912 00000100:00100000:1.0:1789672523.712232:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564262912 00000100:00100000:1.0:1789672523.712289:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672523.712309:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6835:x1876607564262912:12345-0@lo:5: 00002000:00080000:0.0:1789672523.723831:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789672523.723852:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789672523.733533:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6835:x1876607564262912:12345-0@lo:5: Request processed in 21226us (22040us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789672523.733547:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789672523.733589:0:6835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639e15c00 x1876607564262912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672539 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672523.733607:0:6835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6835:1876607564262912:0@lo:5: 00000004:00080000:1.0:1789672523.733624:0:6835:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789672524.018902:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672525.043865:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672526.070185:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789672527.037091:0:7053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789672527.102021:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672528.117570:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672528.819139:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672528.819166:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564263040:0@lo:13: 00000100:00100000:0.0:1789672528.819268:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672528.819379:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263040 00000100:00100000:1.0:1789672528.819389:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263040 00000100:00100000:1.0:1789672528.819460:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672528.819470:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564263040:12345-0@lo:13: 00002000:00000024:1.0:1789672528.819504:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672528.819554:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564263040:12345-0@lo:13: Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672528.819561:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789672528.819956:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672528.823636:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564263168:0@lo:400: 00000100:00100000:1.0:1789672528.823709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789672528.823777:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4c000 x1876607564263040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672528.823824:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564263040:0@lo:13: 00000100:00100000:1.0:1789672528.824119:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263168 00000100:00100000:1.0:1789672528.824127:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263168 00000100:00100000:1.0:1789672528.824172:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789672528.824182:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3300:x1876607564263168:12345-0@lo:400: 00000100:00100000:1.0:1789672528.824237:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3300:x1876607564263168:12345-0@lo:400: Request processed in 56us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672528.824244:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789672528.824294:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564263168:0@lo:400: 00000100:00100000:1.0:1789672528.824387:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564263296:0@lo:400: 00000100:00100000:1.0:1789672528.824414:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672528.824438:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672528.824445:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564263424:0@lo:400: 00000100:00100000:1.0:1789672528.824466:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672528.824530:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263296 00000100:00100000:1.0:1789672528.824535:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263296 00000100:00100000:1.0:1789672528.824562:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263424 00000100:00100000:1.0:1789672528.824565:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263424 00000100:00100000:1.0:1789672528.824605:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672528.824612:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564263296:12345-0@lo:400: 00000100:00100000:1.0:1789672528.824649:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564263296:12345-0@lo:400: Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672528.824656:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672528.824669:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672528.824675:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564263424:12345-0@lo:400: 00000100:00100000:1.0:1789672528.824715:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564263424:12345-0@lo:400: Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672528.824733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789672528.824778:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa641b30000 x1876607564263424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672528.824813:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564263424:0@lo:400: 00010000:00080000:1.0:1789672528.824825:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa641b33800 x1876607564263296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672528.824835:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564263296:0@lo:400: 00000100:00080000:0.0:1789672528.826448:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789672528.881678:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789672529.139169:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672530.162960:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672531.187296:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672532.221027:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672533.235051:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672533.940240:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672533.940267:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564263552:0@lo:13: 00000100:00100000:1.0:1789672533.940334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672533.940514:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263552 00000100:00100000:1.0:1789672533.940524:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263552 00000100:00100000:1.0:1789672533.940628:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672533.940637:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564263552:12345-0@lo:13: 00002000:00000024:1.0:1789672533.940681:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672533.940803:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564263552:12345-0@lo:13: Request processed in 88us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672533.940813:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789672533.940982:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4f100 x1876607564263552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672533.940993:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789672533.941013:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564263552:0@lo:13: 00000100:00080000:2.0:1789672533.943273:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672533.943596:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564263808:0@lo:400: 00000100:00100000:1.0:1789672533.943877:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672533.943969:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672533.943972:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672533.943983:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564263680:0@lo:400: 00000100:00100000:1.0:1789672533.943983:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564263936:0@lo:400: 00000100:00100000:1.0:1789672533.944019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672533.944038:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672533.944057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263808 00000100:00100000:1.0:1789672533.944063:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263808 00000100:00100000:2.0:1789672533.944100:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263680 00000100:00100000:1.0:1789672533.944101:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564263936 00000100:00100000:2.0:1789672533.944106:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263680 00000100:00100000:1.0:1789672533.944106:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564263936 00000100:00100000:1.0:1789672533.944135:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789672533.944145:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564263808:12345-0@lo:400: 00000100:00100000:2.0:1789672533.944148:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789672533.944159:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3299:x1876607564263680:12345-0@lo:400: 00000100:00100000:1.0:1789672533.944197:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564263808:12345-0@lo:400: Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672533.944216:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789672533.944222:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3299:x1876607564263680:12345-0@lo:400: Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672533.944231:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789672533.944235:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672533.944244:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564263936:12345-0@lo:400: 00000100:00100000:1.0:1789672533.944277:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564263936:12345-0@lo:400: Request processed in 36us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672533.944284:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564263680:0@lo:400: 00000100:00100000:1.0:1789672533.944285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789672533.944321:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789672533.944322:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4d880 x1876607564263936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672533.944335:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564263936:0@lo:400: 00010000:00080000:1.0:1789672533.944343:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4ce00 x1876607564263808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672533.944350:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564263808:0@lo:400: 00010000:00010000:3.0:1789672534.262776:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672535.282973:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672536.309995:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672537.331033:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789672537.490295:0:7621:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789672537.490299:0:7621:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789672537.490500:0:7621:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa63fb87000 00000020:01000004:0.0:1789672537.490515:0:7621:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789672537.490529:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789672537.490550:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fa611cab380) 00000020:00000080:0.0:1789672537.490566:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789672537.501929:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789672537.502193:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789672537.517088:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789672537.521334:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789672537.521454:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789672537.521512:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789672537.521537:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789672537.521959:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789672537.521970:0:7621:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789672537.521982:0:7621:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2247cb9491d086d4 00000020:01000004:3.0:1789672537.521989:0:7621:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789672537.522010:0:7621:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789672537.522014:0:7621:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789672537.522019:0:7621:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789672537.522048:0:7621:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789672537.522052:0:7621:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789672537.538587:0:7621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789672537.538637:0:7621:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.139@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789672537.538641:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789672537.538643:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672537.538644:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672537.538646:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672537.538647:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672537.538648:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672537.538649:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672537.538651:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672537.538653:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672537.538654:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672537.538656:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672537.538661:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789672537.538663:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672537.538664:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672537.538665:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672537.538667:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672537.538668:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672537.538669:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672537.538670:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672537.538671:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672537.538672:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672537.538673:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672537.538674:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672537.538707:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789672537.538729:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564264064:0@lo:253: 00000100:00100000:2.0:1789672537.538950:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.539062:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604aa3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672537.539144:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264064 00000100:00100000:1.0:1789672537.539152:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264064 00000100:00100000:1.0:1789672537.539249:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789672537.539259:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:7621:x1876607564264064:12345-0@lo:253: 20000000:01000000:1.0:1789672537.539289:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789672537.539292:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789672537.539297:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789672537.539300:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789672537.540043:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789672537.540260:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789672537.540275:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789672537.540309:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789672537.540316:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789672537.540340:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789672537.540376:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789672537.540605:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789672537.540618:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.139@tcp 20000000:01000000:1.0:1789672537.540620:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.139@tcp (null) (null) (null) 00000040:00080000:1.0:1789672537.540638:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789672537.540642:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789672537.540666:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789672537.540670:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.139@tcp (null) (null) 00000040:00080000:1.0:1789672537.540699:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789672537.540705:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789672537.540720:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789672537.540747:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789672537.541863:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789672537.541888:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.139@tcp 20000000:01000000:0.0:1789672537.541890:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.139@tcp (null) (null) (null) 00000040:00080000:0.0:1789672537.541925:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789672537.541932:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789672537.541962:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789672537.541970:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.139@tcp (null) (null) 00000040:00080000:0.0:1789672537.542000:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789672537.542009:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789672537.542051:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789672537.542088:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789672537.542103:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789672537.542106:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789672537.542112:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789672537.542114:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789672537.542116:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789672537.542129:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789672537.542132:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789672537.542165:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789672537.542179:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672537.545908:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672537.546005:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672537.546038:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789672537.546327:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789672537.546371:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789672537.546448:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789672537.546463:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789672537.546466:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789672537.546976:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789672537.548995:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789672537.549061:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789672537.549131:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789672537.549146:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789672537.549149:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789672537.549714:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789672537.549760:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789672537.549841:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789672537.550092:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789672537.550131:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789672537.550197:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789672537.550210:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789672537.550213:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789672537.550610:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789672537.550637:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789672537.550665:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789672537.550908:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789672537.550932:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789672537.550949:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:2.0:1789672537.550961:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789672537.550978:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.550991:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08625 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.550997:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0864f expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551002:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08679 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551009:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08695 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551016:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551022:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551064:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551077:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 16 pid: 5824 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672537.551091:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264192:0@lo:104: 00000100:00100000:2.0:1789672537.551159:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672537.551252:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08695 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551261:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08695 expref: 16 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672537.551268:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608070000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264320:0@lo:104: 00010000:00010000:2.0:1789672537.551294:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08679 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551301:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08679 expref: 16 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672537.551309:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264448:0@lo:104: 00010000:00010000:2.0:1789672537.551330:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0864f expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551337:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0864f expref: 16 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672537.551344:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608073100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264576:0@lo:104: 00010000:00010000:2.0:1789672537.551376:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08625 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551384:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08625 expref: 16 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672537.551391:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264704:0@lo:104: 00000100:00100000:2.0:1789672537.551408:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672537.551510:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789672537.551529:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.551585:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.551637:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.551656:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264192 00000100:00100000:2.0:1789672537.551662:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264192 00000100:00100000:2.0:1789672537.551693:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264320 00000100:00100000:2.0:1789672537.551696:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264320 00000100:00100000:2.0:1789672537.551705:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264448 00000100:00100000:2.0:1789672537.551708:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264448 00000100:00100000:2.0:1789672537.551719:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672537.551728:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61029ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:5825:x1876607564264192:12345-0@lo:104: 00010000:00010000:2.0:1789672537.551740:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.551997:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672537.552004:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61029ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:5825:x1876607564264192:12345-0@lo:104: Request processed in 277us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.552011:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672537.552053:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789672537.552060:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:5825:x1876607564264320:12345-0@lo:104: 00010000:00010000:2.0:1789672537.552067:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.552105:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672537.552117:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:5825:x1876607564264320:12345-0@lo:104: Request processed in 59us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.552124:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789672537.552135:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789672537.552141:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564264448:12345-0@lo:104: 00010000:00010000:2.0:1789672537.552149:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.552188:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789672537.552193:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564264448:12345-0@lo:104: Request processed in 52us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.552198:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789672537.552248:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789672537.552260:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552267:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030a00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672537.552271:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552293:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672537.552300:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672537.552306:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672537.552341:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552348:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672537.552367:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552375:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030a00/0x2247cb9491d086b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d086bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552387:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672537.552390:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552396:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f3200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672537.552398:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552405:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672537.552412:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672537.552424:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672537.552436:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552441:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672537.552447:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552453:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3200/0x2247cb9491d08695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0869c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552464:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672537.552467:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552472:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672537.552474:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552481:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672537.552486:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672537.552492:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672537.552502:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552508:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672537.552529:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552536:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee400/0x2247cb9491d08679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08680 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552546:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672537.552548:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672537.552550:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672537.552565:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564264832:0@lo:103: 00000100:00100000:1.0:1789672537.552598:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.552636:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672537.552642:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564264960:0@lo:103: 00000100:00100000:1.0:1789672537.552663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.552694:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564265088:0@lo:103: 00000100:00100000:1.0:1789672537.552714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.552748:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264832 00000100:00100000:1.0:1789672537.552753:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264832 00010000:00010000:1.0:1789672537.552774:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 17 pid: 5824 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.552822:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264960 00000100:00100000:1.0:1789672537.552826:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264960 00010000:00010000:1.0:1789672537.552837:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08695 expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.552846:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265088 00000100:00100000:1.0:1789672537.552849:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265088 00010000:00010000:1.0:1789672537.552857:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08679 expref: 19 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.552882:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672537.552887:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564264832:12345-0@lo:103: 00010000:00010000:1.0:1789672537.552898:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672537.552904:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 19 pid: 5824 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552914:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 19 pid: 5824 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.552929:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672537.552959:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564264832:12345-0@lo:103: Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.552965:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672537.552979:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789672537.552985:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3299:x1876607564264960:12345-0@lo:103: 00010000:00010000:1.0:1789672537.552991:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672537.552995:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08695 expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553003:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08695 expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553013:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672537.553032:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3299:x1876607564264960:12345-0@lo:103: Request processed in 48us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.553037:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789672537.553049:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672537.553061:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564265088:12345-0@lo:103: 00010000:00010000:1.0:1789672537.553068:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672537.553072:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08679 expref: 17 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553080:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08679 expref: 17 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553089:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672537.553114:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564265088:12345-0@lo:103: Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.553120:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672537.553161:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564265088:0@lo:103: 00000100:00100000:1.0:1789672537.553198:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564264960:0@lo:103: 00000100:00100000:1.0:1789672537.553205:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564264832:0@lo:103: 00000100:00100000:0.0:1789672537.553412:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.553424:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264576 00000100:00100000:0.0:1789672537.553427:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264576 00000100:00100000:0.0:1789672537.553447:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564264704 00000100:00100000:0.0:1789672537.553449:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564264704 00000100:00100000:0.0:1789672537.553459:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672537.553464:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:5825:x1876607564264576:12345-0@lo:104: 00010000:00010000:0.0:1789672537.553472:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.553514:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672537.553519:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:5825:x1876607564264576:12345-0@lo:104: Request processed in 55us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.553525:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672537.553537:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672537.553543:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564264704:12345-0@lo:104: 00010000:00010000:0.0:1789672537.553557:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.553584:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789672537.553591:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5825:x1876607564264704:12345-0@lo:104: Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.553596:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789672537.553667:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672537.553672:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553678:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600031200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672537.553682:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553688:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672537.553694:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672537.553709:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672537.553740:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553746:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672537.553765:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553771:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600031200/0x2247cb9491d0864f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08656 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553781:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672537.553813:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553820:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ef200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672537.553823:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553829:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672537.553835:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672537.553841:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672537.553853:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553859:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672537.553877:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553883:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef200/0x2247cb9491d08625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0862c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.553899:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672537.553901:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672537.553903:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672537.553910:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672537.553919:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564265344:0@lo:103: 00000100:00100000:1.0:1789672537.553946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.553977:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672537.553984:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564265216:0@lo:103: 00000100:00100000:1.0:1789672537.554003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.554026:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265344 00000100:00100000:1.0:1789672537.554031:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265344 00010000:00010000:1.0:1789672537.554047:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08625 expref: 17 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.554066:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265216 00000100:00100000:1.0:1789672537.554068:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265216 00010000:00010000:1.0:1789672537.554078:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0864f expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.554090:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672537.554096:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3300:x1876607564265344:12345-0@lo:103: 00010000:00010000:1.0:1789672537.554104:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672537.554108:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08625 expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554129:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08625 expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554140:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672537.554178:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3300:x1876607564265344:12345-0@lo:103: Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.554184:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672537.554197:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672537.554204:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564265216:12345-0@lo:103: 00010000:00010000:1.0:1789672537.554211:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672537.554215:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0864f expref: 17 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554223:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0864f expref: 17 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554235:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554244:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554259:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554267:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554273:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554286:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554292:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672537.554296:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554303:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554311:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.554320:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672537.554347:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564265216:12345-0@lo:103: Request processed in 144us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.554354:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672537.554383:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564265344:0@lo:103: 00000100:00100000:1.0:1789672537.554401:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564265216:0@lo:103: 00010000:00010000:3.0:1789672537.554644:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031c00/0x2247cb9491d086bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d086b8 expref: 16 pid: 5824 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.554655:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264192:0@lo:104: 00010000:00010000:3.0:1789672537.554664:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672537.554676:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031a00/0x2247cb9491d0869c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08695 expref: 15 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.554696:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608070000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264320:0@lo:104: 00010000:00010000:3.0:1789672537.554710:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929ee00/0x2247cb9491d08680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08679 expref: 14 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.554717:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264448:0@lo:104: 00010000:00010000:3.0:1789672537.554725:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0864f expref: 13 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.554734:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608073100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264576:0@lo:104: 00010000:00010000:3.0:1789672537.554741:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929e200/0x2247cb9491d0862c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08625 expref: 12 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.554749:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5825:1876607564264704:0@lo:104: 00010000:00010000:3.0:1789672537.554767:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.554775:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.554781:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.554968:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929f800/0x2247cb9491d086db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672537.554981:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789672537.593623:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:7621:x1876607564264064:12345-0@lo:253: Request processed in 54353us (54660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.593659:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789672537.593754:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564264064:0@lo:253: 10000000:01000000:2.0:1789672537.593769:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789672537.593773:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672537.593775:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672537.593776:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672537.593777:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789672537.593778:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672537.593779:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672537.593781:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672537.593782:0:7621:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789672537.594042:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672537.594043:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789672537.594067:0:7621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa63fb87000 from lustre-OST0001 10000000:01000000:2.0:1789672537.594092:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789672537.594096:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789672537.594103:0:7621:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa6103db380 local copy 10000000:01000000:2.0:1789672537.594106:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789672537.594142:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.594163:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.594184:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672537.594202:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265472:0@lo:101: 00000100:00100000:2.0:1789672537.594235:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.594302:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672537.594339:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265472 00000100:00100000:1.0:1789672537.594457:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265472 00000100:00100000:1.0:1789672537.594590:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789672537.594599:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+11:7621:x1876607564265472:12345-0@lo:101: 00010000:00010000:1.0:1789672537.594612:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672537.594624:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d086e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d086e2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.594646:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d086e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d086e2 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.594662:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d086e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d086e2 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.594671:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f3200, rc 0) 00000100:00100000:1.0:1789672537.594710:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564265472:12345-0@lo:101: Request processed in 112us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.594715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789672537.594771:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608073800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265472:0@lo:101: 00010000:00010000:0.0:1789672537.594783:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.594809:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672537.594895:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265600:0@lo:501: 00000100:00100000:0.0:1789672537.594918:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.595149:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672537.595202:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265600 00000100:00100000:2.0:1789672537.595206:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265600 00000100:00100000:2.0:1789672537.595226:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672537.595232:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564265600:12345-0@lo:501: 00000100:00100000:2.0:1789672537.595414:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564265600:12345-0@lo:501: Request processed in 181us (494us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672537.595421:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789672537.595482:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265600:0@lo:501: 10000000:01000000:0.0:1789672537.595494:0:7621:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789672537.595515:0:7621:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789672537.595520:0:7621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.595529:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.595537:0:7621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.595565:0:7621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789672537.595582:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa63fb87000 10000000:01000000:0.0:1789672537.595586:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789672537.595590:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789672537.595593:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789672537.595596:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789672537.595599:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789672537.595613:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.595620:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.595629:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672537.595640:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265728:0@lo:101: 00000100:00100000:0.0:1789672537.595662:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.595672:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789672537.595714:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672537.595720:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595727:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929e600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672537.595731:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595739:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672537.595746:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672537.595757:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672537.595775:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595780:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672537.595824:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595831:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d086e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2247cb9491d086e9 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595842:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672537.595844:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672537.595845:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672537.595853:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265728 00000100:00100000:2.0:1789672537.595856:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265728 00000100:00100000:2.0:1789672537.595870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789672537.595875:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564265728:12345-0@lo:101: 00010000:00010000:2.0:1789672537.595881:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672537.595889:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d086f0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595903:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595912:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.595919:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ea00, rc 0) 00000100:00100000:2.0:1789672537.595946:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564265728:12345-0@lo:101: Request processed in 70us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.595951:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789672537.596023:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564265856:0@lo:103: 00000100:00100000:0.0:1789672537.596048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.596108:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265728:0@lo:101: 00010000:00010000:0.0:1789672537.596117:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.596125:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672537.596192:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265984:0@lo:501: 00000100:00100000:0.0:1789672537.596211:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.596221:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672537.596353:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265856 00000100:00100000:2.0:1789672537.596357:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265856 00000100:00100000:2.0:1789672537.596388:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672537.596394:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3300:x1876607564265856:12345-0@lo:103: 00010000:00010000:2.0:1789672537.596401:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672537.596411:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d086e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d086e2 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.596421:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672537.596445:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3300:x1876607564265856:12345-0@lo:103: Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.596450:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672537.596469:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564265856:0@lo:103: 00000100:00100000:2.0:1789672537.596481:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564265984 00000100:00100000:2.0:1789672537.596484:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564265984 00000100:00100000:2.0:1789672537.596496:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789672537.596500:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564265984:12345-0@lo:501: 00000100:00100000:2.0:1789672537.596636:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564265984:12345-0@lo:501: Request processed in 135us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.596642:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789672537.596741:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564265984:0@lo:501: 00000100:00100000:0.0:1789672537.596764:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266112:0@lo:503: 00000100:00100000:0.0:1789672537.596821:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.596840:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672537.596902:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266112 00000100:00100000:2.0:1789672537.596906:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266112 00000100:00100000:2.0:1789672537.596921:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789672537.596926:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266112:12345-0@lo:503: 00000100:00100000:2.0:1789672537.597044:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266112:12345-0@lo:503: Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.597055:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789672537.597133:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266112:0@lo:503: 00000040:00080000:0.0:1789672537.597451:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789672537.597512:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266240:0@lo:502: 00000100:00100000:0.0:1789672537.597549:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.597572:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672537.597688:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266240 00000100:00100000:2.0:1789672537.597694:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266240 00000100:00100000:2.0:1789672537.597713:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789672537.597718:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266240:12345-0@lo:502: 00000100:00100000:2.0:1789672537.597880:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266240:12345-0@lo:502: Request processed in 160us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.597886:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789672537.598239:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266240:0@lo:502: 00000040:00080000:0.0:1789672537.598493:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789672537.598544:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789672537.598579:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789672537.598626:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789672537.598664:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789672537.598698:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789672537.598724:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266368:0@lo:502: 00000100:00100000:0.0:1789672537.598767:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.598836:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672537.598923:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266368 00000100:00100000:2.0:1789672537.598928:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266368 00000100:00100000:2.0:1789672537.598955:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789672537.598962:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266368:12345-0@lo:502: 00000100:00100000:2.0:1789672537.599104:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266368:12345-0@lo:502: Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672537.599111:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789672537.599350:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266368:0@lo:502: 00000040:00080000:0.0:1789672537.599440:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789672537.599459:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789672537.600107:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789672537.600115:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789672537.600121:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672537.600123:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789672537.600129:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789672537.600143:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fa611ca8000) 00000020:00000080:0.0:1789672537.600164:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789672537.600179:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789672537.600236:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa63fb87000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789672537.600243:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789672537.600248:0:7628:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2247cb9491d08705 00010000:00010000:1.0:1789672537.606687:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789672537.607289:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789672537.611364:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789672537.611645:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789672537.615746:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789672537.616527:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789672537.618451:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789672537.618462:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672537.618468:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672537.618470:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789672537.618474:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672537.618477:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672537.618479:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672537.618482:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672537.618484:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789672537.618538:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672537.618542:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672537.618543:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789672537.618546:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789672537.620464:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789672537.620500:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789672537.622538:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.622555:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672537.622721:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa63fb87000 from 1 10000000:01000000:1.0:1789672537.622725:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672537.622762:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.622779:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.624477:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.624504:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266496:0@lo:101: 00000100:00100000:1.0:1789672537.624568:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.624617:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672537.625279:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266496 00000100:00100000:3.0:1789672537.625290:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266496 00000100:00100000:3.0:1789672537.625361:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672537.625371:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:7621:x1876607564266496:12345-0@lo:101: 00010000:00010000:3.0:1789672537.625389:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672537.625405:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0870c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.625431:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0870c expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.625444:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0870c expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.625454:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6421efa00, rc 0) 00000100:00100000:3.0:1789672537.625506:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266496:12345-0@lo:101: Request processed in 137us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.625512:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789672537.625653:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266496:0@lo:101: 00010000:00010000:1.0:1789672537.625669:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.625679:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672537.625815:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266624:0@lo:501: 00000100:00100000:1.0:1789672537.625843:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.625876:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672537.626948:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266624 00000100:00100000:3.0:1789672537.626960:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266624 00000100:00100000:3.0:1789672537.627007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789672537.627028:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266624:12345-0@lo:501: 00000100:00100000:3.0:1789672537.627323:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266624:12345-0@lo:501: Request processed in 296us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.627331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789672537.627636:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266624:0@lo:501: 00000100:00100000:1.0:1789672537.627681:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266752:0@lo:503: 00000100:00100000:1.0:1789672537.627725:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.627762:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672537.628489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266752 00000100:00100000:3.0:1789672537.628496:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266752 00000100:00100000:3.0:1789672537.628550:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789672537.628558:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266752:12345-0@lo:503: 00000100:00100000:3.0:1789672537.628933:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266752:12345-0@lo:503: Request processed in 374us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.628942:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789672537.629184:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266752:0@lo:503: 00000040:00080000:1.0:1789672537.629503:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672537.629598:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266880:0@lo:502: 00000100:00100000:1.0:1789672537.629645:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.629685:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672537.629827:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564266880 00000100:00100000:0.0:1789672537.629833:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564266880 00000100:00100000:0.0:1789672537.629874:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789672537.629881:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266880:12345-0@lo:502: 00000100:00100000:0.0:1789672537.630072:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564266880:12345-0@lo:502: Request processed in 190us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.630079:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789672537.630284:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564266880:0@lo:502: 00000040:00080000:1.0:1789672537.630610:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789672537.630661:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789672537.630689:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267008:0@lo:502: 00000100:00100000:1.0:1789672537.630730:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672537.630830:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c7ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672537.631163:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267008 00000100:00100000:0.0:1789672537.631179:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267008 00000100:00100000:0.0:1789672537.631253:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789672537.631262:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564267008:12345-0@lo:502: 00000100:00100000:0.0:1789672537.631449:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564267008:12345-0@lo:502: Request processed in 188us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.631456:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789672537.631527:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267008:0@lo:502: 00000040:00080000:2.0:1789672537.631614:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789672537.631625:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789672537.632296:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672537.632304:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672537.632307:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789672537.632314:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa63fb87000 00000020:00000080:2.0:1789672537.632317:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789672537.632334:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672537.632338:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672537.632339:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789672537.632352:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789672537.632529:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789672537.632551:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789672537.632570:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.632581:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672537.632621:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789672537.632624:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa63fb87000 10000000:01000000:3.0:1789672537.632626:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa63fb87000 10000000:01000000:3.0:1789672537.632630:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789672537.632634:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa63fb87000 from 1 10000000:01000000:3.0:1789672537.632636:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672537.632663:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.632670:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.632680:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.632696:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267136:0@lo:101: 00000100:00100000:3.0:1789672537.632739:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672537.633038:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63ac70900 going to sleep for 11 seconds 00000100:00100000:1.0:1789672537.633158:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267136 00000100:00100000:1.0:1789672537.633164:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267136 00000100:00100000:1.0:1789672537.633207:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789672537.633214:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564267136:12345-0@lo:101: 00010000:00010000:1.0:1789672537.633225:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672537.633237:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0871a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.633257:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0871a expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.633267:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0871a expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672537.633275:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f2400, rc 0) 00000100:00100000:1.0:1789672537.633366:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267136:12345-0@lo:101: Request processed in 152us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.633373:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789672537.633555:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267136:0@lo:101: 00010000:00010000:3.0:1789672537.633569:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.640819:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.641003:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267264:0@lo:501: 00000100:00100000:3.0:1789672537.641197:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672537.641241:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63ac70900 going to sleep for 11 seconds 00000100:00100000:1.0:1789672537.641315:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267264 00000100:00100000:1.0:1789672537.641329:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267264 00000100:00100000:1.0:1789672537.641387:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789672537.641396:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267264:12345-0@lo:501: 00000100:00100000:1.0:1789672537.641630:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267264:12345-0@lo:501: Request processed in 234us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.641638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789672537.641856:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267264:0@lo:501: 00000100:00100000:2.0:1789672537.641891:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267392:0@lo:503: 00000100:00100000:2.0:1789672537.641925:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.641937:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672537.641982:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267392 00000100:00100000:3.0:1789672537.641987:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267392 00000100:00100000:3.0:1789672537.642020:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789672537.642027:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267392:12345-0@lo:503: 00000100:00100000:3.0:1789672537.642177:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267392:12345-0@lo:503: Request processed in 141us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.642184:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789672537.642308:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267392:0@lo:503: 00000040:00080000:2.0:1789672537.642558:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789672537.642608:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267520:0@lo:502: 00000100:00100000:2.0:1789672537.642645:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.642674:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672537.642781:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267520 00000100:00100000:3.0:1789672537.642812:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267520 00000100:00100000:3.0:1789672537.642839:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789672537.642846:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267520:12345-0@lo:502: 00000100:00100000:3.0:1789672537.643007:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267520:12345-0@lo:502: Request processed in 161us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.643089:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789672537.643280:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267520:0@lo:502: 00000040:00080000:2.0:1789672537.643605:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789672537.643655:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789672537.643691:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789672537.643737:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789672537.643773:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789672537.643868:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789672537.643900:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789672537.643927:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789672537.643964:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789672537.643995:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789672537.645531:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789672537.645642:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789672537.645680:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789672537.645710:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789672537.646420:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789672537.646477:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789672537.646513:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789672537.646565:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789672537.646599:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789672537.646629:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789672537.646686:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789672537.646722:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789672537.646756:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789672537.646837:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789672537.646874:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789672537.646906:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789672537.646956:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789672537.646991:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789672537.647026:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789672537.647075:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789672537.647128:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789672537.647165:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789672537.647212:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789672537.647252:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789672537.647280:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789672537.647316:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789672537.647426:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789672537.647474:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267648:0@lo:502: 00000100:00100000:2.0:1789672537.647552:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.647600:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672537.647711:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267648 00000100:00100000:3.0:1789672537.647718:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267648 00000100:00100000:3.0:1789672537.647766:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789672537.647778:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267648:12345-0@lo:502: 00000100:00100000:3.0:1789672537.648140:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564267648:12345-0@lo:502: Request processed in 361us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672537.648148:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789672537.648256:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564267648:0@lo:502: 00000040:00080000:2.0:1789672537.648317:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789672537.648326:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789672537.655543:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789672537.655580:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fa62f3c4d40) 00000020:00000080:1.0:1789672537.655604:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789672537.655715:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa63fb87000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789672537.655719:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa63fb87000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789672537.655721:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa63fb87000 3 00010000:00080000:1.0:1789672537.655751:0:7633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa62f3d6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.139@tcp at head 00010000:00010000:1.0:1789672537.657428:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789672537.657624:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789672537.657659:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789672537.657670:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2247cb9491d0872f 00000100:00080000:1.0:1789672537.657681:0:7633:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672537.657691:0:7633:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa62f3d6800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672537.657726:0:7633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa639d4d880 x1876607564267776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672537.657760:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789672537.658126:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564268032:0@lo:400: 00000100:00100000:0.0:1789672537.658202:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.658235:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672537.658241:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564267904:0@lo:400: 00000100:00100000:0.0:1789672537.658262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.658281:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672537.658288:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564268160:0@lo:400: 00000100:00100000:0.0:1789672537.658314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.658355:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268160 00000100:00100000:0.0:1789672537.658363:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268160 00000100:00100000:0.0:1789672537.658418:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672537.658429:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564268160:12345-0@lo:400: 00000100:00100000:0.0:1789672537.658478:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564268160:12345-0@lo:400: Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.658485:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789672537.658503:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672537.658531:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639e15500 x1876607564268160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672537.658543:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564268160:0@lo:400: 00000100:00100000:3.0:1789672537.658850:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564267776:0@lo:38: 00000100:00100000:3.0:1789672537.658885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789672537.660989:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1789672537.661260:0:7634:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9fa641b32300 x1876607564268288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672537.661272:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39a80 going to sleep for 0 seconds 00000020:01000000:2.0:1789672537.661435:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789672537.661470:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672537.661494:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672537.661506:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789672537.661565:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789672537.661567:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672537.661569:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672537.661570:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672537.661571:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672537.661573:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672537.661574:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672537.661576:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672537.661577:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672537.661579:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672537.661580:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789672537.661584:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789672537.661586:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672537.661587:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672537.661589:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672537.661590:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672537.661591:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672537.661592:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672537.661593:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672537.661594:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672537.661595:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672537.661596:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672537.661597:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789672537.661611:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789672537.661620:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564268416:0@lo:253: 00000100:00100000:2.0:1789672537.661681:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.661763:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672537.662321:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268032 00000100:00100000:1.0:1789672537.662329:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268032 00000100:00100000:1.0:1789672537.662460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267904 00000100:00100000:1.0:1789672537.662464:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267904 00000100:00100000:1.0:1789672537.662476:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564267776 00000100:00100000:1.0:1789672537.662479:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564267776 00000100:00100000:1.0:1789672537.662491:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672537.662509:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564268032:12345-0@lo:400: 00000100:00100000:1.0:1789672537.662638:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564268032:12345-0@lo:400: Request processed in 129us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.662645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672537.662662:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672537.662668:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564267904:12345-0@lo:400: 00000100:00100000:1.0:1789672537.662696:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564267904:12345-0@lo:400: Request processed in 29us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.662701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672537.662713:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672537.662717:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564267776:12345-0@lo:38: 00010000:00080000:1.0:1789672537.662737:0:5830:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1789672537.662767:0:5830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2247cb9491d08736 00000004:00100000:1.0:1789672537.662780:0:5830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789672537.662825:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672537.662862:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876607564267776:12345-0@lo:38: Request processed in 144us (3976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.662868:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789672537.662909:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639d4d880 x1876607564267776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672537.662919:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672537.662926:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789672537.662932:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789672537.662936:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789672537.663054:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672537.663084:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789672537.663092:0:3298:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fda75f36): req@ffff9fa641b32300 x1876607564268288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672537.663126:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564267776:0@lo:38: 00000100:00100000:2.0:1789672537.663476:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672537.663504:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672537.663553:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268288 00000100:00100000:1.0:1789672537.663559:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268288 00000100:00100000:1.0:1789672537.663622:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672537.663628:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1876607564268288:12345-0@lo:901: 00000100:00100000:1.0:1789672537.663989:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1876607564268288:12345-0@lo:901: Request processed in 361us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672537.663995:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672537.664519:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268416 00000100:00100000:0.0:1789672537.664526:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268416 00000100:00100000:0.0:1789672537.664563:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789672537.664570:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:7621:x1876607564268416:12345-0@lo:253: 20000000:01000000:0.0:1789672537.664603:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789672537.664618:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1789672537.665060:0:7634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa641b32300 x1876607564268288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789672553 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672537.665074:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1876607564268288:0@lo:901: 00010000:00080000:3.0:1789672537.666120:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639e17b80 x1876607564268032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672537.666134:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564268032:0@lo:400: 00010000:00080000:3.0:1789672537.666691:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa639e17100 x1876607564267904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672537.666702:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564267904:0@lo:400: 00000100:00080000:2.0:1789672537.669996:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1789672537.699255:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789672537.699274:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789672537.700028:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789672537.700033:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789672537.700055:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.700072:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08687 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.700080:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.700135:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08687 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672537.700149:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08687 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672537.700163:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876607564268544:0@lo:104: 00000100:00100000:3.0:1789672537.700234:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672537.700282:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672537.700356:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268544 00000100:00100000:0.0:1789672537.700365:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268544 00000100:00100000:0.0:1789672537.700414:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672537.700423:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5846:x1876607564268544:12345-0@lo:104: 00010000:00010000:0.0:1789672537.700435:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700487:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672537.700493:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:5846:x1876607564268544:12345-0@lo:104: Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.700498:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789672537.700517:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672537.700523:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700528:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f2a00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672537.700532:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700541:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672537.700548:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672537.700553:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672537.700584:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700590:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672537.700606:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700612:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2a00/0x2247cb9491d08687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0868e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700626:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672537.700628:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672537.700629:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672537.700646:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564268672:0@lo:103: 00000100:00100000:0.0:1789672537.700676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672537.700707:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268672 00000100:00100000:0.0:1789672537.700711:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268672 00010000:00010000:0.0:1789672537.700727:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08687 expref: 15 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672537.700745:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672537.700751:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:3300:x1876607564268672:12345-0@lo:103: 00010000:00010000:0.0:1789672537.700761:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672537.700766:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08687 expref: 15 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700775:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08687 expref: 15 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700818:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700833:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789672537.700846:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005495827s 00010000:00010000:0.0:1789672537.700850:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700856:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700862:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700868:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700873:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421eec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672537.700877:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700884:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700893:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.700902:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672537.700931:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:3300:x1876607564268672:12345-0@lo:103: Request processed in 180us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.700938:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672537.700995:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564268672:0@lo:103: 00010000:00010000:0.0:1789672537.701018:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030c00/0x2247cb9491d0868e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08687 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672537.701029:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1876607564268544:0@lo:104: 00010000:00010000:0.0:1789672537.701041:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.701051:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.701058:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672537.701064:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d0873d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672537.708330:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:7621:x1876607564268416:12345-0@lo:253: Request processed in 43752us (46640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672537.708353:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789672537.708479:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3c6595f6-f042-46a8-abe4-2c10b8a32248:7621:1876607564268416:0@lo:253: 10000000:01000000:2.0:1789672537.708494:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789672537.708498:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672537.708510:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672537.708511:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672537.708512:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672537.708513:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672537.708515:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672537.708516:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672537.708517:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672537.708519:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672537.708520:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672537.708522:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789672537.708538:0:7621:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789672537.713947:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672537.714235:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672537.714513:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672537.714709:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672537.714946:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672537.715329:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789672537.716517:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789672537.876270:0:7621:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789672537.876277:0:7621:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789672537.876385:0:7621:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789672537.876439:0:7621:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789672537.876454:0:7621:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789672537.876492:0:7621:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789672538.356519:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672539.062614:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564268800:0@lo:13: 00000100:00100000:1.0:1789672539.062697:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672539.063069:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268800 00000100:00100000:0.0:1789672539.063082:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268800 00000100:00080000:2.0:1789672539.063169:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672539.063172:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672539.063191:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564268800:12345-0@lo:13: 00002000:00000024:0.0:1789672539.063244:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1789672539.063587:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e15500 x1876607564268800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672539.063628:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564268800:0@lo:13: 00000100:00100000:0.0:1789672539.064071:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564268800:12345-0@lo:13: Request processed in 885us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672539.064082:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789672539.381227:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672540.404631:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672541.431178:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672542.452013:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672543.157910:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564269312:0@lo:400: 00000100:00100000:3.0:1789672543.157979:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672543.158038:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789672543.158045:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564268928:0@lo:400: 00000100:00100000:3.0:1789672543.158094:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672543.158128:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564269440:0@lo:400: 00000100:00100000:3.0:1789672543.158152:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672543.158182:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269312 00000100:00100000:3.0:1789672543.158189:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269312 00000100:00100000:3.0:1789672543.158241:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672543.158250:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564269312:12345-0@lo:400: 00000100:00080000:2.0:1789672543.158546:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672543.158710:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564269056:0@lo:400: 00000100:00100000:0.0:1789672543.158741:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672543.158772:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672543.158778:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564269184:0@lo:400: 00000100:00100000:0.0:1789672543.158823:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672543.158855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269440 00000100:00100000:0.0:1789672543.158860:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269440 00000100:00100000:0.0:1789672543.158889:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269056 00000100:00100000:0.0:1789672543.158892:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269056 00000100:00100000:0.0:1789672543.158905:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269184 00000100:00100000:0.0:1789672543.158908:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269184 00000100:00100000:0.0:1789672543.158922:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672543.158929:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564269440:12345-0@lo:400: 00000100:00100000:2.0:1789672543.158998:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672543.159008:0:5832:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789672543.159255:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564269440:12345-0@lo:400: Request processed in 325us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672543.159263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672543.159281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672543.159287:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564269056:12345-0@lo:400: 00000100:00100000:0.0:1789672543.159568:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564269056:12345-0@lo:400: Request processed in 280us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672543.159575:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672543.159588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672543.159595:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564269184:12345-0@lo:400: 00000100:00100000:0.0:1789672543.159622:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564269184:12345-0@lo:400: Request processed in 28us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672543.159628:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789672543.159642:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789672543.164598:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b31880 x1876607564269056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672543.164617:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564269056:0@lo:400: 00010000:00080000:2.0:1789672543.164648:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b33480 x1876607564269184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672543.164657:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564269184:0@lo:400: 00000100:00100000:3.0:1789672543.164896:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564269312:12345-0@lo:400: Request processed in 6644us (6914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672543.164908:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672543.164944:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564268928 00000100:00100000:3.0:1789672543.164951:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564268928 00000100:00100000:3.0:1789672543.165001:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789672543.165008:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3301:x1876607564268928:12345-0@lo:400: 00000100:00100000:3.0:1789672543.165070:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:3301:x1876607564268928:12345-0@lo:400: Request processed in 63us (6976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672543.165076:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789672543.165685:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564268928:0@lo:400: 00010000:00080000:3.0:1789672543.165700:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b30700 x1876607564269440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672543.165709:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564269440:0@lo:400: 00010000:00080000:3.0:1789672543.165722:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b32680 x1876607564269312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672543.165730:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564269312:0@lo:400: 00010000:00010000:0.0:1789672543.474948:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672544.180076:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672544.180117:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564269568:0@lo:13: 00000100:00100000:0.0:1789672544.180194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672544.180355:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269568 00000100:00100000:1.0:1789672544.180364:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269568 00000100:00100000:1.0:1789672544.180412:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672544.180421:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564269568:12345-0@lo:13: 00002000:00000024:1.0:1789672544.180539:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672544.181414:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564269568:12345-0@lo:13: Request processed in 990us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672544.181424:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789672544.181684:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e15500 x1876607564269568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672544.181710:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564269568:0@lo:13: 00000001:02000400:2.0:1789672544.189544:0:7978:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789672544.498954:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672545.524250:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789672545.719354:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789672545.719367:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa6117c1000 from 30 10000000:01000000:1.0:1789672545.719374:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789672545.719433:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672545.719448:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672545.719463:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672545.719494:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564269696:0@lo:101: 00000100:00100000:1.0:1789672545.719606:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.719668:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.720033:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269696 00000100:00100000:0.0:1789672545.720046:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269696 00000100:00100000:0.0:1789672545.720138:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789672545.720151:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564269696:12345-0@lo:101: 00010000:00010000:0.0:1789672545.720171:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672545.720189:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08744 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.720220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08744 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.720232:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08744 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.720242:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031400, rc 0) 00000100:00100000:0.0:1789672545.720322:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564269696:12345-0@lo:101: Request processed in 173us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.720329:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789672545.720396:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564269696:0@lo:101: 00010000:00010000:0.0:1789672545.720415:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.720432:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672545.720501:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564269824:0@lo:501: 00000100:00100000:0.0:1789672545.720530:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672545.720556:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.721073:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269824 00000100:00100000:2.0:1789672545.721080:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269824 00000100:00100000:2.0:1789672545.721130:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789672545.721138:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564269824:12345-0@lo:501: 00000100:00100000:2.0:1789672545.722298:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564269824:12345-0@lo:501: Request processed in 1152us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.722311:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789672545.725058:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564269824:0@lo:501: 00000100:00100000:1.0:1789672545.725151:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564269952:0@lo:503: 00000100:00100000:1.0:1789672545.725242:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.726149:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.731723:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564269952 00000100:00100000:0.0:1789672545.731745:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564269952 00000100:00100000:0.0:1789672545.731842:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789672545.731856:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564269952:12345-0@lo:503: 00000100:00100000:0.0:1789672545.736244:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564269952:12345-0@lo:503: Request processed in 4376us (10987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.736276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789672545.737549:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564269952:0@lo:503: 00000100:00100000:3.0:1789672545.742393:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8053:1876607564270080:0@lo:502: 00000100:00100000:3.0:1789672545.742507:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.742578:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.742646:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270080 00000100:00100000:0.0:1789672545.742656:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270080 00000100:00100000:0.0:1789672545.742718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789672545.742728:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8053:x1876607564270080:12345-0@lo:502: 00000100:00100000:0.0:1789672545.743169:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8053:x1876607564270080:12345-0@lo:502: Request processed in 440us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.743178:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789672545.743826:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8053:1876607564270080:0@lo:502: 00000100:00100000:3.0:1789672545.743921:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8053:1876607564270208:0@lo:502: 00000100:00100000:3.0:1789672545.743974:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.744009:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.744232:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270208 00000100:00100000:0.0:1789672545.744239:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270208 00000100:00100000:0.0:1789672545.744297:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789672545.744307:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8053:x1876607564270208:12345-0@lo:502: 00000100:00100000:0.0:1789672545.744536:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8053:x1876607564270208:12345-0@lo:502: Request processed in 230us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.744555:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789672545.744863:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8053:1876607564270208:0@lo:502: 00000040:00080000:3.0:1789672545.744899:0:8053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789672545.745154:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789672545.745178:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672545.745190:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.745202:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672545.745214:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789672545.745217:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789672545.745220:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789672545.745257:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.746081:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.746114:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672545.746141:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270336:0@lo:101: 00000100:00100000:0.0:1789672545.746210:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672545.746298:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672545.758007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270336 00000100:00100000:3.0:1789672545.758029:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270336 00000100:00100000:3.0:1789672545.758167:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789672545.758180:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564270336:12345-0@lo:101: 00010000:00010000:3.0:1789672545.758206:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672545.758233:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08752 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.758271:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08752 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.758286:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08752 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.758296:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6421ee000, rc 0) 00000100:00100000:3.0:1789672545.760120:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564270336:12345-0@lo:101: Request processed in 1928us (13895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672545.760135:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789672545.763207:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270336:0@lo:101: 00010000:00010000:2.0:1789672545.763249:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.763268:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672545.766352:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270464:0@lo:501: 00000100:00100000:0.0:1789672545.766449:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672545.766496:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.766716:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270464 00000100:00100000:2.0:1789672545.766725:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270464 00000100:00100000:2.0:1789672545.766779:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789672545.766865:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564270464:12345-0@lo:501: 00000100:00100000:2.0:1789672545.768741:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564270464:12345-0@lo:501: Request processed in 1870us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.768755:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789672545.769967:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270464:0@lo:501: 00000100:00100000:1.0:1789672545.770062:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270592:0@lo:503: 00000100:00100000:1.0:1789672545.770171:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.770216:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.771114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270592 00000100:00100000:0.0:1789672545.771126:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270592 00000100:00100000:0.0:1789672545.771203:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789672545.771213:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564270592:12345-0@lo:503: 00000100:00100000:0.0:1789672545.771836:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564270592:12345-0@lo:503: Request processed in 622us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.771845:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789672545.772039:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270592:0@lo:503: 00000100:00100000:1.0:1789672545.772412:0:8055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8055:1876607564270720:0@lo:502: 00000100:00100000:1.0:1789672545.772460:0:8055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.772502:0:8055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.772716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270720 00000100:00100000:0.0:1789672545.772723:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270720 00000100:00100000:0.0:1789672545.772822:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789672545.772831:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8055:x1876607564270720:12345-0@lo:502: 00000100:00100000:0.0:1789672545.773068:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8055:x1876607564270720:12345-0@lo:502: Request processed in 237us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.773075:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789672545.776394:0:8055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8055:1876607564270720:0@lo:502: 00000020:01000000:1.0:1789672545.776452:0:8055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672545.776466:0:8055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672545.776469:0:8055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672545.776476:0:8055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672545.776478:0:8055:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789672545.776523:0:8055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8055:1876607564270848:0@lo:502: 00000100:00100000:1.0:1789672545.776626:0:8055:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.777803:0:8055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.780967:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270848 00000100:00100000:2.0:1789672545.780990:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270848 00000100:00100000:2.0:1789672545.781084:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789672545.781108:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8055:x1876607564270848:12345-0@lo:502: 00000100:00100000:2.0:1789672545.781554:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8055:x1876607564270848:12345-0@lo:502: Request processed in 448us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.781563:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789672545.786756:0:8055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8055:1876607564270848:0@lo:502: 00000020:01000000:0.0:1789672545.792839:0:8055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672545.792864:0:8055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672545.792867:0:8055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789672545.792875:0:8055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789672545.793211:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789672545.793239:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789672545.793253:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793268:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672545.793281:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789672545.793284:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa604b25800 from 30 10000000:01000000:3.0:1789672545.793288:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672545.793336:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793345:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793358:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672545.793387:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270976:0@lo:101: 00000100:00100000:3.0:1789672545.793478:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.793530:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564270976 00000100:00100000:3.0:1789672545.793540:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564270976 00000100:00100000:3.0:1789672545.793674:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672545.793686:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564270976:12345-0@lo:101: 00010000:00010000:3.0:1789672545.793703:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672545.793721:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08760 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793805:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08760 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793819:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08760 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793830:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6421eec00, rc 0) 00000100:00100000:3.0:1789672545.793870:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564270976:12345-0@lo:101: Request processed in 187us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672545.793876:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672545.793927:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672545.793952:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564270976:0@lo:101: 00010000:00010000:3.0:1789672545.793968:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672545.793978:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672545.794032:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271104:0@lo:501: 00000100:00100000:3.0:1789672545.794083:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.794115:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672545.794132:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271104 00000100:00100000:3.0:1789672545.794137:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271104 00000100:00100000:3.0:1789672545.794163:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789672545.794169:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564271104:12345-0@lo:501: 00000100:00100000:3.0:1789672545.794489:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564271104:12345-0@lo:501: Request processed in 318us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672545.794504:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789672545.794537:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271104:0@lo:501: 00000100:00100000:3.0:1789672545.794566:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271232:0@lo:503: 00000100:00100000:3.0:1789672545.794611:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.794633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271232 00000100:00100000:3.0:1789672545.794637:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271232 00000100:00100000:3.0:1789672545.794658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789672545.794664:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564271232:12345-0@lo:503: 00000100:00100000:3.0:1789672545.794842:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564271232:12345-0@lo:503: Request processed in 177us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672545.794850:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789672545.794878:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672545.794889:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271232:0@lo:503: 00000100:00100000:1.0:1789672545.806421:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8057:1876607564271360:0@lo:502: 00000100:00100000:1.0:1789672545.806555:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.806908:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.806998:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271360 00000100:00100000:2.0:1789672545.807009:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271360 00000100:00100000:2.0:1789672545.807077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789672545.807101:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8057:x1876607564271360:12345-0@lo:502: 00000100:00100000:2.0:1789672545.807429:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8057:x1876607564271360:12345-0@lo:502: Request processed in 341us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.807438:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789672545.807594:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8057:1876607564271360:0@lo:502: 00000100:00100000:1.0:1789672545.807664:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8057:1876607564271488:0@lo:502: 00000100:00100000:1.0:1789672545.807703:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.807738:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.808124:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271488 00000100:00100000:2.0:1789672545.808131:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271488 00000100:00100000:2.0:1789672545.808167:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672545.808175:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8057:x1876607564271488:12345-0@lo:502: 00000100:00100000:2.0:1789672545.808370:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8057:x1876607564271488:12345-0@lo:502: Request processed in 194us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.808378:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789672545.808475:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8057:1876607564271488:0@lo:502: 00000040:00080000:1.0:1789672545.808501:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789672545.808857:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789672545.808882:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672545.808893:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.808907:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672545.808917:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789672545.808921:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa604b25800 from 5 10000000:01000000:2.0:1789672545.808924:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789672545.808961:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.808971:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.808981:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672545.809001:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271616:0@lo:101: 00000100:00100000:2.0:1789672545.809040:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672545.809068:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672545.809475:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271616 00000100:00100000:1.0:1789672545.809483:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271616 00000100:00100000:1.0:1789672545.809540:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789672545.809549:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564271616:12345-0@lo:101: 00010000:00010000:1.0:1789672545.809561:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672545.809687:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3e00/0x2247cb9491d08775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0876e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672545.809725:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3e00/0x2247cb9491d08775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0876e expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672545.809738:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f3e00/0x2247cb9491d08775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0876e expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672545.809747:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f3e00, rc 0) 00000100:00100000:1.0:1789672545.809829:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564271616:12345-0@lo:101: Request processed in 281us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672545.809836:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672545.810191:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271616:0@lo:101: 00010000:00010000:2.0:1789672545.810209:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.810220:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672545.810285:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271744:0@lo:256: 00000100:00100000:2.0:1789672545.810329:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672545.810357:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271744 00000100:00100000:2.0:1789672545.810363:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271744 00000100:00100000:2.0:1789672545.810391:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789672545.810398:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564271744:12345-0@lo:256: 20000000:01000000:2.0:1789672545.810415:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789672545.810437:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789672545.810440:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789672545.810724:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564271744:12345-0@lo:256: Request processed in 118us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.810732:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789672545.810774:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.812865:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271744:0@lo:256: 10000000:01000000:2.0:1789672545.812961:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789672545.812973:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.812985:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672545.813012:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789672545.813015:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789672545.813019:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789672545.813067:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.813076:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672545.813087:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672545.813122:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271872:0@lo:101: 00000100:00100000:2.0:1789672545.813208:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672545.813258:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.813378:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564271872 00000100:00100000:0.0:1789672545.813389:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564271872 00000100:00100000:0.0:1789672545.813450:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789672545.813460:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564271872:12345-0@lo:101: 00010000:00010000:0.0:1789672545.813476:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672545.813492:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0877c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.814203:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0877c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.814221:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0877c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.814247:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600030800, rc 0) 00000100:00100000:0.0:1789672545.814453:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564271872:12345-0@lo:101: Request processed in 992us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.814462:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789672545.815677:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564271872:0@lo:101: 00010000:00010000:1.0:1789672545.815707:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672545.815720:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672545.818854:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564272000:0@lo:501: 00000100:00100000:1.0:1789672545.818953:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.819456:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.823968:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272000 00000100:00100000:0.0:1789672545.823993:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272000 00000100:00100000:2.0:1789672545.825900:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789672545.825915:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564272000:12345-0@lo:501: 00000100:00100000:2.0:1789672545.826368:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564272000:12345-0@lo:501: Request processed in 455us (7413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.826377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789672545.826450:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564272000:0@lo:501: 00000100:00100000:2.0:1789672545.826520:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564272128:0@lo:503: 00000100:00100000:2.0:1789672545.826575:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672545.826615:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.826694:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272128 00000100:00100000:0.0:1789672545.826701:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272128 00000100:00100000:0.0:1789672545.826740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789672545.826748:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564272128:12345-0@lo:503: 00000100:00100000:0.0:1789672545.827135:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564272128:12345-0@lo:503: Request processed in 386us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.827143:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789672545.827247:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564272128:0@lo:503: 00000100:00100000:2.0:1789672545.828416:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8058:1876607564272256:0@lo:502: 00000100:00100000:2.0:1789672545.828492:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672545.828547:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608283000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.828683:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272256 00000100:00100000:0.0:1789672545.828691:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272256 00000100:00100000:0.0:1789672545.828740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672545.828749:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8058:x1876607564272256:12345-0@lo:502: 00000100:00100000:0.0:1789672545.829117:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8058:x1876607564272256:12345-0@lo:502: Request processed in 367us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.829125:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789672545.829762:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8058:1876607564272256:0@lo:502: 00000020:01000000:2.0:1789672545.829819:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789672545.829829:0:8058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789672545.829837:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672545.829839:0:8058:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789672545.829845:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789672545.829851:0:8058:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.139@tcp to nid 0x20000c0a8ca8b (192.168.202.139@tcp) 00000020:01000000:2.0:1789672545.829877:0:8058:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789672545.829879:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672545.829900:0:8058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fa62f1e4d40) 00000020:00000080:2.0:1789672545.829927:0:8058:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789672545.829932:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789672545.830021:0:8058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789672545.830028:0:8058:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789672545.830036:0:8058:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d08791 00010000:00080000:2.0:1789672545.830071:0:8058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa639b28800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.139@tcp at head 00010000:00010000:2.0:1789672545.830365:0:8058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789672545.834006:0:8058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789672545.834034:0:8058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789672545.839933:0:8058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672545.840332:0:8058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672545.840388:0:8058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789672545.840446:0:8058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789672545.859057:0:8059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672545.859070:0:8059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789672545.863415:0:8058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672545.863438:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789672545.863490:0:8058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789672545.863522:0:8058:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d08798 00000100:00080000:1.0:1789672545.863536:0:8058:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672545.863552:0:8058:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa639b28800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672545.863600:0:8058:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa639d4c700 x1876607564272384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672545.863646:0:8058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789672545.863725:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672545.863730:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672545.863731:0:8058:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789672545.863735:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672545.863739:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672545.863740:0:8058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672545.863743:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672545.863746:0:8058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789672545.863778:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8058:1876607564272768:0@lo:502: 00000100:00100000:0.0:1789672545.863852:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564272512:0@lo:400: 00000100:00100000:3.0:1789672545.863932:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564272384:0@lo:8: 00000100:00100000:1.0:1789672545.864481:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672545.864535:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272768 00000100:00100000:1.0:1789672545.864536:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672545.864545:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272768 00000100:00100000:2.0:1789672545.864622:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789672545.864633:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8058:x1876607564272768:12345-0@lo:502: 00000100:00100000:2.0:1789672545.865005:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8058:x1876607564272768:12345-0@lo:502: Request processed in 372us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.865020:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789672545.865079:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8058:1876607564272768:0@lo:502: 00000020:01000000:1.0:1789672545.865127:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672545.865258:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672545.865261:0:8058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789672545.865267:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1789672545.870128:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564272896:0@lo:400: 00000100:00100000:3.0:1789672545.870349:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.870486:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.870525:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672545.870532:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564272640:0@lo:400: 00000100:00100000:1.0:1789672545.870559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672545.870596:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564273024:0@lo:400: 00000100:00100000:1.0:1789672545.870620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.870694:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272384 00000100:00100000:3.0:1789672545.870705:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272384 00000100:00100000:1.0:1789672545.870721:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272640 00000100:00100000:1.0:1789672545.870724:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272640 00000100:00100000:3.0:1789672545.870745:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272896 00000100:00100000:3.0:1789672545.870748:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272896 00000100:00100000:1.0:1789672545.870769:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273024 00000100:00100000:1.0:1789672545.870771:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273024 00000100:00100000:3.0:1789672545.870801:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672545.870812:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564272896:12345-0@lo:400: 00000100:00100000:1.0:1789672545.870835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672545.870840:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564272640:12345-0@lo:400: 00000100:00100000:1.0:1789672545.870875:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564272640:12345-0@lo:400: Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672545.870883:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672545.870903:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789672545.870909:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564273024:12345-0@lo:400: 00000100:00100000:1.0:1789672545.870942:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564273024:12345-0@lo:400: Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672545.870947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672545.872018:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672545.872032:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789672545.872161:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672545.872169:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1876607564272384:12345-0@lo:8: 00010000:00080000:2.0:1789672545.872207:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1789672545.872246:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d0879f 00002000:00100000:2.0:1789672545.872265:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fa639b2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789672545.872270:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789672545.872274:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789672545.872437:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789672545.872633:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789672545.872666:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fa639b29000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672545.872759:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876607564272384:12345-0@lo:8: Request processed in 588us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672545.872767:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672545.872921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789672545.872977:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789672545.873019:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789672545.873032:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873063:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672545.873076:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789672545.873080:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa6103db380 from 1 10000000:01000000:0.0:1789672545.873084:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789672545.873135:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873144:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873156:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672545.873177:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564273152:0@lo:101: 00000100:00100000:0.0:1789672545.873223:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672545.873255:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.873281:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564272512 00000100:00100000:0.0:1789672545.873289:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564272512 00000100:00100000:0.0:1789672545.873326:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672545.873333:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564272512:12345-0@lo:400: 00000100:00100000:0.0:1789672545.873373:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564272512:12345-0@lo:400: Request processed in 41us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.873380:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672545.873414:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273152 00000100:00100000:0.0:1789672545.873418:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273152 00000100:00100000:0.0:1789672545.873444:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672545.873456:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564273152:12345-0@lo:101: 00010000:00010000:0.0:1789672545.873466:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672545.873481:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d087a6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873508:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873520:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873529:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031a00, rc 0) 00000100:00100000:0.0:1789672545.873558:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564273152:12345-0@lo:101: Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672545.873564:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672545.873622:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564273152:0@lo:101: 00010000:00010000:0.0:1789672545.873639:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.873649:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672545.873704:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564273280:0@lo:501: 00000100:00100000:0.0:1789672545.873729:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672545.873744:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672545.873757:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273280 00000100:00100000:0.0:1789672545.873761:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273280 00000100:00080000:1.0:1789672545.873896:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672545.873903:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789672545.873920:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639d4c700 x1876607564272384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672545.873932:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:1.0:1789672545.873934:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23800 x1876607564273024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789672545.873940:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:1.0:1789672545.873943:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564273024:0@lo:400: 00000100:00080000:2.0:1789672545.873949:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789672545.873955:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789672545.873958:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa639b28800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789672545.873975:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789672545.873981:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564272384:0@lo:8: 00000100:00100000:0.0:1789672545.874169:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789672545.874178:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564273280:12345-0@lo:501: 00000100:00100000:0.0:1789672545.875467:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564273280:12345-0@lo:501: Request processed in 1282us (1728us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672545.875479:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789672545.875545:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564273280:0@lo:501: 10000000:01000000:0.0:1789672545.875581:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789672545.875591:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672545.875603:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789672545.875667:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e16d80 x1876607564272512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672545.875680:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564272512:0@lo:400: 00000100:00100000:3.0:1789672545.876223:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564272896:12345-0@lo:400: Request processed in 5408us (5733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672545.876236:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1789672545.876291:0:8059:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789672545.876444:0:8059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214657657855ns, next at 0ns, rc = 0 00010000:00080000:1.0:1789672545.879051:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e17b80 x1876607564272640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672545.879076:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564272640:0@lo:400: 00010000:00080000:1.0:1789672545.879120:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e15500 x1876607564272896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672545.879130:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564272896:0@lo:400: 00000004:00080000:2.0:1789672545.976142:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789672545.976441:0:8061:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789672545.976477:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564273536:0@lo:7: 00000100:00100000:3.0:1789672545.976563:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.976629:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672545.976653:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564273408:0@lo:13: 00000100:00100000:3.0:1789672545.976679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672545.976726:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273536 00000100:00100000:3.0:1789672545.976735:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273536 00000100:00100000:3.0:1789672545.977114:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789672545.977127:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8061:x1876607564273536:12345-0@lo:7: 00000100:00080000:1.0:1789672545.978100:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672545.978123:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273408 00000100:00100000:1.0:1789672545.978130:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273408 00000100:00100000:1.0:1789672545.978199:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672545.978207:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564273408:12345-0@lo:13: 00002000:00000024:1.0:1789672545.978247:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789672545.978332:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564273408:12345-0@lo:13: Request processed in 125us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672545.978339:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789672545.985555:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b30700 x1876607564273408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672545.987439:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564273408:0@lo:13: 00002000:00080000:3.0:1789672546.000515:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789672546.000530:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789672546.000727:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8061:x1876607564273536:12345-0@lo:7: Request processed in 23598us (24158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672546.000740:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789672546.003415:0:8061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b30000 x1876607564273536/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789672561 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672546.003438:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564273536:0@lo:7: 00000004:00080000:2.0:1789672546.003459:0:8061:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789672546.003516:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564273664:0@lo:5: 00000100:00100000:2.0:1789672546.003593:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672546.003672:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61db58600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672546.005107:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273664 00000100:00100000:3.0:1789672546.005122:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273664 00000100:00100000:2.0:1789672546.005414:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672546.005429:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8061:x1876607564273664:12345-0@lo:5: 00002000:00080000:2.0:1789672546.005470:0:8063:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789672546.005475:0:8063:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789672546.007923:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8061:x1876607564273664:12345-0@lo:5: Request processed in 2486us (4317us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789672546.007941:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789672546.008455:0:8061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608071f80 x1876607564273664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672562 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672546.008477:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564273664:0@lo:5: 00000004:00080000:2.0:1789672546.008495:0:8061:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789672546.008555:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564273792:0@lo:700: 00000100:00100000:2.0:1789672546.008611:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672546.008659:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61db58600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672546.008715:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273792 00000100:00100000:1.0:1789672546.008724:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273792 00000100:00100000:0.0:1789672546.008885:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672546.008898:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8061:x1876607564273792:12345-0@lo:700: 00000100:00100000:0.0:1789672546.008946:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1876607564273920:0@lo:700: 00000100:00100000:0.0:1789672546.009052:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672546.009107:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672546.009278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564273920 00000100:00100000:2.0:1789672546.009283:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564273920 00000100:00100000:2.0:1789672546.009326:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672546.009333:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1876607564273920:12345-0@lo:700: 40000000:02000000:3.0:1789672546.085886:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789672546.102715:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6692:x1876607564273920:12345-0@lo:700: Request processed in 93372us (93652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672546.102735:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789672546.103176:0:6692:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e21880 x1876607564273920/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789672562 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672546.103196:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6692:1876607564273920:0@lo:700: 40000000:02000000:0.0:1789672546.103214:0:6692:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1789672546.220900:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8061:x1876607564273792:12345-0@lo:700: Request processed in 211995us (212280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672546.220915:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789672546.221066:0:8061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608071c00 x1876607564273792/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789672562 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672546.221083:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564273792:0@lo:700: 00000001:00080000:2.0:1789672546.221657:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1789672546.221667:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1789672546.258261:0:8061:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789672546.262738:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564274048:0@lo:5: 00000100:00100000:2.0:1789672546.262931:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672546.262992:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa635762480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672546.263075:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274048 00000100:00100000:3.0:1789672546.263095:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274048 00000100:00100000:3.0:1789672546.263144:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672546.263153:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8061:x1876607564274048:12345-0@lo:5: 00002000:00080000:2.0:1789672546.268951:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789672546.268974:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789672546.272660:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8061:x1876607564274048:12345-0@lo:5: Request processed in 9500us (9720us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789672546.272674:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789672546.272773:0:8061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608071c00 x1876607564274048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672562 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672546.272814:0:8061:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789672546.272830:0:8061:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fa608071c00 x1876607564274048/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672562 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672546.272842:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8061:1876607564274048:0@lo:5: 00000004:00080000:2.0:1789672546.272857:0:8061:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789672546.550471:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672547.572623:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672548.596452:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672549.299113:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672549.299155:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564274176:0@lo:13: 00000100:00100000:2.0:1789672549.299250:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672549.301010:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274176 00000100:00100000:0.0:1789672549.301028:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274176 00000100:00100000:0.0:1789672549.301133:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672549.301148:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564274176:12345-0@lo:13: 00002000:00000024:0.0:1789672549.301200:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672549.301292:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564274176:12345-0@lo:13: Request processed in 149us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672549.301300:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789672549.301328:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672549.301374:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e21880 x1876607564274176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672549.301398:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564274176:0@lo:13: 00000001:00080000:1.0:1789672549.450622:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789672549.625782:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672549.977752:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672549.977823:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543279744 00000100:00100000:3.0:1789672549.977837:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543279744 00000100:00100000:3.0:1789672549.977892:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 110 00000100:00100000:3.0:1789672549.977901:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1876607543279744:12345-192.168.202.39@tcp:250: 00010000:00080000:3.0:1789672549.977938:0:5824:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7f8f297e-d024-4f2e-b44a-c373b0e97659@192.168.202.39@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1789672549.977977:0:5824:0:(genops.c:1384:class_connect()) connect: client 7f8f297e-d024-4f2e-b44a-c373b0e97659, cookie 0x2247cb9491d087b4 00000100:00080000:3.0:1789672549.978166:0:5824:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3b0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672549.978261:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+5:2356:x1876607543279744:12345-192.168.202.39@tcp:250: Request processed in 359us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672549.978271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 110 00000100:00100000:0.0:1789672549.988421:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672549.988567:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543279872 00000100:00100000:2.0:1789672549.988581:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543279872 00000100:00100000:2.0:1789672549.988649:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 111 00000100:00100000:2.0:1789672549.988661:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+5:5584:x1876607543279872:12345-192.168.202.39@tcp:101: 00010000:00010000:2.0:1789672549.988684:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672549.988720:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf6aa expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672549.988758:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672549.988773:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672549.988809:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929e200, rc 0) 00000100:00100000:2.0:1789672549.988883:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+6:5584:x1876607543279872:12345-192.168.202.39@tcp:101: Request processed in 223us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672549.988891:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 111 00000100:00100000:3.0:1789672549.994068:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672549.994123:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280000 00000100:00100000:3.0:1789672549.994137:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280000 00000100:00100000:3.0:1789672549.994203:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 112 00000100:00100000:3.0:1789672549.994214:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+6:5584:x1876607543280000:12345-192.168.202.39@tcp:501: 00000100:00100000:3.0:1789672549.994711:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+6:5584:x1876607543280000:12345-192.168.202.39@tcp:501: Request processed in 497us (668us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672549.994721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 112 00000100:00100000:3.0:1789672550.019879:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672550.022781:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280128 00000100:00100000:0.0:1789672550.022827:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280128 00000100:00100000:0.0:1789672550.022913:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 113 00000100:00100000:0.0:1789672550.022926:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+6:5584:x1876607543280128:12345-192.168.202.39@tcp:101: 00010000:00010000:0.0:1789672550.022950:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672550.022974:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf6b1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672550.023039:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672550.023064:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672550.023076:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600030a00, rc 0) 00000100:00100000:0.0:1789672550.023164:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+7:5584:x1876607543280128:12345-192.168.202.39@tcp:101: Request processed in 241us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672550.023172:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 113 00000100:00100000:3.0:1789672550.025948:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672550.026116:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280256 00000100:00100000:0.0:1789672550.026129:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280256 00000100:00100000:0.0:1789672550.026202:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:0.0:1789672550.026214:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+7:5584:x1876607543280256:12345-192.168.202.39@tcp:501: 00000100:00100000:0.0:1789672550.026720:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5584:x1876607543280256:12345-192.168.202.39@tcp:501: Request processed in 495us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672550.026729:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:0.0:1789672550.037639:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672550.037742:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280384 00000100:00100000:1.0:1789672550.037756:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280384 00000100:00100000:1.0:1789672550.037860:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:1.0:1789672550.037873:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5584:x1876607543280384:12345-192.168.202.39@tcp:503: 00000100:00100000:1.0:1789672550.038206:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5584:x1876607543280384:12345-192.168.202.39@tcp:503: Request processed in 335us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672550.038216:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:0.0:1789672550.044141:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672550.044257:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280512 00000100:00100000:3.0:1789672550.044273:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280512 00000100:00100000:0.0:1789672550.044472:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 116 00000100:00100000:0.0:1789672550.044491:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5602:x1876607543280512:12345-192.168.202.39@tcp:502: 00000100:00100000:0.0:1789672550.044926:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5602:x1876607543280512:12345-192.168.202.39@tcp:502: Request processed in 442us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672550.044937:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 116 00000100:00100000:1.0:1789672550.071445:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672550.071535:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280640 00000100:00100000:0.0:1789672550.071568:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280640 00000100:00100000:0.0:1789672550.071639:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 117 00000100:00100000:0.0:1789672550.071651:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5602:x1876607543280640:12345-192.168.202.39@tcp:502: 00000100:00100000:0.0:1789672550.072029:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5602:x1876607543280640:12345-192.168.202.39@tcp:502: Request processed in 376us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672550.072038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 117 00000100:00100000:0.0:1789672550.082780:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672550.083014:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280768 00000100:00100000:3.0:1789672550.083030:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280768 00000100:00100000:3.0:1789672550.083110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 118 00000100:00100000:3.0:1789672550.083123:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5584:x1876607543280768:12345-192.168.202.39@tcp:101: 00010000:00010000:3.0:1789672550.083166:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672550.083192:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6421ef200/0x2247cb9491d087c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf6db expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672550.083239:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421ef200/0x2247cb9491d087c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6db expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672550.083254:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6421ef200/0x2247cb9491d087c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6db expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672550.083265:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6421ef200, rc 0) 00000100:00100000:3.0:1789672550.083451:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5584:x1876607543280768:12345-192.168.202.39@tcp:101: Request processed in 216us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672550.083460:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 118 00000100:00100000:3.0:1789672550.086152:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672550.086273:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543280896 00000100:00100000:2.0:1789672550.086287:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543280896 00000100:00100000:2.0:1789672550.086362:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 119 00000100:00100000:2.0:1789672550.086374:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5584:x1876607543280896:12345-192.168.202.39@tcp:256: 20000000:01000000:2.0:1789672550.086408:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789672550.086445:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789672550.086450:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789672550.086454:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789672550.086456:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789672550.093262:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5584:x1876607543280896:12345-192.168.202.39@tcp:256: Request processed in 6859us (7093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672550.093286:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 119 00000100:00100000:1.0:1789672550.104878:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672550.105036:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281024 00000100:00100000:3.0:1789672550.105061:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281024 00000100:00100000:3.0:1789672550.105132:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:3.0:1789672550.105145:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5584:x1876607543281024:12345-192.168.202.39@tcp:101: 00010000:00010000:3.0:1789672550.105171:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672550.105197:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf6e2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672550.105248:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672550.105263:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672550.105301:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6421ee400, rc 0) 00000100:00100000:3.0:1789672550.105384:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5584:x1876607543281024:12345-192.168.202.39@tcp:101: Request processed in 241us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672550.105392:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:3.0:1789672550.112621:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672550.112811:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281152 00000100:00100000:1.0:1789672550.112826:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281152 00000100:00100000:1.0:1789672550.112899:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 121 00000100:00100000:1.0:1789672550.112911:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5584:x1876607543281152:12345-192.168.202.39@tcp:501: 00000100:00100000:1.0:1789672550.113328:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5584:x1876607543281152:12345-192.168.202.39@tcp:501: Request processed in 417us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672550.113541:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 121 00000100:00100000:1.0:1789672550.115398:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672550.115949:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281280 00000100:00100000:3.0:1789672550.115963:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281280 00000100:00100000:0.0:1789672550.117852:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 122 00000100:00100000:0.0:1789672550.117869:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5584:x1876607543281280:12345-192.168.202.39@tcp:503: 00000100:00100000:0.0:1789672550.118895:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5584:x1876607543281280:12345-192.168.202.39@tcp:503: Request processed in 1023us (3563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672550.118908:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 122 00000100:00100000:2.0:1789672550.126955:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672550.127043:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281408 00000100:00100000:3.0:1789672550.127068:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281408 00000100:00100000:3.0:1789672550.127142:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 123 00000100:00100000:3.0:1789672550.127155:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5606:x1876607543281408:12345-192.168.202.39@tcp:502: 00000100:00100000:3.0:1789672550.130509:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5606:x1876607543281408:12345-192.168.202.39@tcp:502: Request processed in 3324us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672550.130528:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 123 00000100:00100000:3.0:1789672550.144515:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672550.145903:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281536 00000100:00100000:2.0:1789672550.145921:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281536 00000100:00100000:2.0:1789672550.145993:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 124 00000100:00100000:2.0:1789672550.146005:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5606:x1876607543281536:12345-192.168.202.39@tcp:502: 00000100:00100000:2.0:1789672550.146644:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5606:x1876607543281536:12345-192.168.202.39@tcp:502: Request processed in 637us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672550.146666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 124 00000100:00100000:3.0:1789672550.151099:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672550.151170:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281664 00000100:00100000:3.0:1789672550.151184:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281664 00000100:00100000:2.0:1789672550.152228:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:2.0:1789672550.152241:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1876607543281664:12345-192.168.202.39@tcp:38: 00010000:00080000:2.0:1789672550.152284:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1789672550.153668:0:5831:0:(genops.c:1384:class_connect()) connect: client 7225c799-181e-4570-897c-b66842e45960, cookie 0x2247cb9491d087d7 00000004:00100000:2.0:1789672550.153722:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789672550.153731:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789672550.216046:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9fa63519f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672550.216174:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+6:2356:x1876607543281664:12345-192.168.202.39@tcp:38: Request processed in 63930us (65428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672550.216189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00010000:00010000:0.0:1789672550.643605:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672551.236404:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672551.236469:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672551.236578:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281920 00000100:00100000:3.0:1789672551.236591:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281920 00000100:00080000:0.0:1789672551.236680:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672551.236700:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543281792 00000100:00100000:3.0:1789672551.236704:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543281792 00000100:00100000:3.0:1789672551.236740:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:3.0:1789672551.236753:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:5584:x1876607543281920:12345-192.168.202.39@tcp:41: 00000100:00100000:0.0:1789672551.236806:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672551.236820:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+7:0:x1876607543281792:12345-192.168.202.39@tcp:41: 00000004:00000024:3.0:1789672551.236859:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789672551.236951:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:5584:x1876607543281920:12345-192.168.202.39@tcp:41: Request processed in 200us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672551.236991:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000004:00000024:0.0:1789672551.241148:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789672551.241317:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+6:0:x1876607543281792:12345-192.168.202.39@tcp:41: Request processed in 4494us (4838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672551.241336:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:3.0:1789672551.242116:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672551.242764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282048 00000100:00100000:1.0:1789672551.242777:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282048 00000100:00100000:1.0:1789672551.242891:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:1.0:1789672551.242904:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:5584:x1876607543282048:12345-192.168.202.39@tcp:40: 00000100:00100000:1.0:1789672551.243029:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:5584:x1876607543282048:12345-192.168.202.39@tcp:40: Request processed in 127us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672551.243047:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:3.0:1789672551.251682:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672551.251746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672551.251914:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282176 00000100:00100000:0.0:1789672551.251929:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282176 00000100:00100000:0.0:1789672551.252077:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:0.0:1789672551.252191:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1876607543282176:12345-192.168.202.39@tcp:8: 00000100:00100000:3.0:1789672551.252472:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672551.252519:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672551.252546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282560 00000100:00100000:3.0:1789672551.252551:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282560 00000100:00100000:3.0:1789672551.252595:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 125 00000100:00100000:3.0:1789672551.252614:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543282560:12345-192.168.202.39@tcp:400: 00000100:00100000:3.0:1789672551.252719:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543282560:12345-192.168.202.39@tcp:400: Request processed in 116us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672551.252728:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 125 00010000:00080000:0.0:1789672551.252874:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:0.0:1789672551.252917:0:6684:0:(genops.c:1384:class_connect()) connect: client 7225c799-181e-4570-897c-b66842e45960, cookie 0x2247cb9491d087de 00002000:00100000:0.0:1789672551.252936:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7225c799-181e-4570-897c-b66842e45960/ffff9fa5022af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1789672551.253356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282432 00000100:00100000:1.0:1789672551.253363:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282432 00000100:00100000:1.0:1789672551.253407:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:1.0:1789672551.253416:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+6:5584:x1876607543282432:12345-192.168.202.39@tcp:33: 00000100:00100000:1.0:1789672551.257191:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282304 00000100:00100000:1.0:1789672551.257211:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282304 00000100:00100000:1.0:1789672551.257293:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:1.0:1789672551.257303:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1876607543282304:12345-192.168.202.39@tcp:8: 00010000:00080000:1.0:1789672551.257351:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1789672551.257384:0:6685:0:(genops.c:1384:class_connect()) connect: client 7225c799-181e-4570-897c-b66842e45960, cookie 0x2247cb9491d087e5 00002000:00100000:1.0:1789672551.257397:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7225c799-181e-4570-897c-b66842e45960/ffff9fa62f3d1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789672551.257423:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1789672551.257434:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789672551.258622:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789672551.258664:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672551.258745:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2356:x1876607543282304:12345-192.168.202.39@tcp:8: Request processed in 1441us (6272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672551.258755:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00002000:00080000:0.0:1789672551.259699:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789672551.259746:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fa5022a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672551.261469:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:2356:x1876607543282176:12345-192.168.202.39@tcp:8: Request processed in 9266us (9708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672551.261485:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000004:00080000:1.0:1789672551.285108:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31609us 00000004:00200000:2.0:1789672551.305216:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789672551.305400:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+6:5584:x1876607543282432:12345-192.168.202.39@tcp:33: Request processed in 51975us (53726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672551.305421:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:0.0:1789672551.348227:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564274304:0@lo:400: 00000100:00100000:0.0:1789672551.348352:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672551.348430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274304 00000100:00100000:1.0:1789672551.348444:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274304 00000100:00100000:0.0:1789672551.348452:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564274816:0@lo:400: 00000100:00100000:0.0:1789672551.348497:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672551.348511:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789672551.348525:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564274304:12345-0@lo:400: 00000100:00100000:0.0:1789672551.348535:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672551.348545:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564274688:0@lo:400: 00000100:00100000:0.0:1789672551.348590:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672551.348735:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564274432:0@lo:400: 00000100:00100000:1.0:1789672551.349446:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564274304:12345-0@lo:400: Request processed in 923us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672551.349458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789672551.349483:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564274304:0@lo:400: 00000100:00100000:1.0:1789672551.349531:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274816 00000100:00100000:1.0:1789672551.349539:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274816 00000100:00100000:0.0:1789672551.349546:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274688 00000100:00100000:0.0:1789672551.349556:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274688 00000100:00100000:1.0:1789672551.349629:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672551.349637:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564274816:12345-0@lo:400: 00000100:00100000:1.0:1789672551.349695:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564274816:12345-0@lo:400: Request processed in 59us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672551.349701:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672551.349724:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564274560:0@lo:400: 00000100:00100000:1.0:1789672551.349754:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672551.349782:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564275072:0@lo:13: 00000100:00100000:1.0:1789672551.349834:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672551.349867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274560 00000100:00100000:1.0:1789672551.349871:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274560 00000100:00100000:1.0:1789672551.349915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789672551.349922:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564274560:12345-0@lo:400: 00000100:00100000:1.0:1789672551.349958:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564274560:12345-0@lo:400: Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672551.349965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789672551.349996:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639d4c700 x1876607564274560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672551.350025:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564274560:0@lo:400: 00010000:00080000:1.0:1789672551.350085:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639d4fb80 x1876607564274816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672551.350274:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672551.350288:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564274688:12345-0@lo:400: 00000100:00100000:0.0:1789672551.350354:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564274688:12345-0@lo:400: Request processed in 71us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672551.350362:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672551.350402:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275072 00000100:00100000:0.0:1789672551.350410:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275072 00000100:00100000:1.0:1789672551.350428:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564274816:0@lo:400: 00000100:00100000:0.0:1789672551.350455:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789672551.350468:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639d4e300 x1876607564274688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672551.350468:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564275072:12345-0@lo:13: 00000100:00100000:1.0:1789672551.350493:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564274688:0@lo:400: 00002000:00000024:0.0:1789672551.350501:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672551.350563:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564275072:12345-0@lo:13: Request processed in 98us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672551.350572:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789672551.350624:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672551.350630:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672551.350634:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672551.350763:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672551.350849:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564274944:0@lo:400: 00000100:00100000:3.0:1789672551.350879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672551.350978:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274944 00000100:00100000:2.0:1789672551.350984:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274944 00000100:00100000:2.0:1789672551.351021:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672551.351029:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564274944:12345-0@lo:400: 00010000:00080000:0.0:1789672551.351236:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608072a00 x1876607564275072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672551.351248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564274432 00000100:00100000:0.0:1789672551.351250:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789672551.351257:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564274432 00000100:00100000:0.0:1789672551.351288:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564275072:0@lo:13: 00000100:00100000:1.0:1789672551.351311:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672551.351322:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564274432:12345-0@lo:400: 00000100:00100000:0.0:1789672551.351452:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564274944:12345-0@lo:400: Request processed in 422us (569us total) trans 0 rc 0/0 00010000:00080000:3.0:1789672551.351461:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f527480 x1876607564274944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672551.351468:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672551.351486:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564274944:0@lo:400: 00000100:00100000:1.0:1789672551.351628:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564274432:12345-0@lo:400: Request processed in 309us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672551.351638:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789672551.351697:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639d4f100 x1876607564274432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672551.351707:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564274432:0@lo:400: 00000100:00100000:1.0:1789672551.478001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672551.480235:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282688 00000100:00100000:0.0:1789672551.480249:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282688 00000100:00100000:0.0:1789672551.480324:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:0.0:1789672551.480336:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+6:5623:x1876607543282688:12345-192.168.202.39@tcp:101: 00010000:00010000:0.0:1789672551.480356:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672551.480418:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600030000/0x2247cb9491d087ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf70c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672551.480484:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600031c00/0x2247cb9491d087f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672551.480498:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600031c00/0x2247cb9491d087f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672551.480533:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600031c00/0x2247cb9491d087f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672551.480575:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789672551.480580:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672551.480598:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600031c00/0x2247cb9491d087f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672551.480623:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600030000/0x2247cb9491d087ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf70c expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672551.480642:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600031c00/0x2247cb9491d087f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf70c expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672551.480649:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05a00) 00010000:00010000:0.0:1789672551.480651:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672551.480655:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031c00, rc 0) 00000100:00100000:0.0:1789672551.480730:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+7:5623:x1876607543282688:12345-192.168.202.39@tcp:101: Request processed in 396us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672551.480737:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00010000:00010000:1.0:1789672551.667485:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672552.691231:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672552.973641:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00010000:00010000:1.0:1789672553.715045:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672553.766984:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672553.775753:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282816 00000100:00100000:1.0:1789672553.775776:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282816 00000100:00100000:1.0:1789672553.775926:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:1.0:1789672553.775942:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:5676:x1876607543282816:12345-192.168.202.39@tcp:41: 00000100:00080000:2.0:1789672553.775957:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789672553.776004:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789672553.776132:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:5676:x1876607543282816:12345-192.168.202.39@tcp:41: Request processed in 194us (9164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672553.776152:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:3.0:1789672553.782145:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672553.782377:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543282944 00000100:00100000:1.0:1789672553.782393:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543282944 00000100:00100000:1.0:1789672553.782551:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:1.0:1789672553.782565:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7225c799-181e-4570-897c-b66842e45960+5:5676:x1876607543282944:12345-192.168.202.39@tcp:13: 00002000:00000024:1.0:1789672553.782621:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672553.782734:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7225c799-181e-4570-897c-b66842e45960+5:5676:x1876607543282944:12345-192.168.202.39@tcp:13: Request processed in 172us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672553.782742:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00080000:2.0:1789672553.782819:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672553.791397:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672553.791545:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283072 00000100:00100000:0.0:1789672553.791558:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283072 00000100:00100000:0.0:1789672553.791709:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:0.0:1789672553.791725:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7225c799-181e-4570-897c-b66842e45960+6:5676:x1876607543283072:12345-192.168.202.39@tcp:13: 00002000:00000024:0.0:1789672553.791823:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672553.791938:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7225c799-181e-4570-897c-b66842e45960+6:5676:x1876607543283072:12345-192.168.202.39@tcp:13: Request processed in 218us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672553.791946:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00080000:2.0:1789672553.793540:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672554.422921:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564275200:0@lo:13: 00000100:00100000:2.0:1789672554.423039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672554.423307:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275200 00000100:00100000:0.0:1789672554.423319:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275200 00000100:00100000:0.0:1789672554.423409:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672554.423422:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564275200:12345-0@lo:13: 00002000:00000024:0.0:1789672554.423454:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789672554.423638:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672554.424046:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23100 x1876607564275200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672554.424073:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564275200:0@lo:13: 00000100:00100000:0.0:1789672554.424168:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564275200:12345-0@lo:13: Request processed in 747us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672554.424178:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789672554.746424:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672555.513715:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000001:00100000:0.0:1789672555.527691:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00010000:00010000:1.0:1789672555.763065:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672556.469325:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672556.469362:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564275328:0@lo:13: 00000100:00100000:0.0:1789672556.469457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672556.471150:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275328 00000100:00100000:3.0:1789672556.471165:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275328 00000100:00100000:3.0:1789672556.471258:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789672556.471270:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564275328:12345-0@lo:13: 00002000:00000024:3.0:1789672556.471318:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672556.471412:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564275328:12345-0@lo:13: Request processed in 144us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672556.471421:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789672556.471446:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672556.471490:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23480 x1876607564275328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672556.471514:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564275328:0@lo:13: 00000100:00100000:0.0:1789672556.472921:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564275584:0@lo:400: 00000100:00100000:0.0:1789672556.473013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672556.473055:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789672556.473062:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564275456:0@lo:400: 00000100:00100000:0.0:1789672556.473095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672556.473125:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564275968:0@lo:400: 00000100:00100000:0.0:1789672556.473148:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672556.473195:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275584 00000100:00100000:0.0:1789672556.473205:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275584 00000100:00100000:0.0:1789672556.473256:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275968 00000100:00100000:0.0:1789672556.473260:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275968 00000100:00100000:0.0:1789672556.473292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789672556.473302:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564275584:12345-0@lo:400: 00000100:00100000:0.0:1789672556.473381:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564275584:12345-0@lo:400: Request processed in 80us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672556.473388:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789672556.473406:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672556.473412:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564275968:12345-0@lo:400: 00000100:00100000:0.0:1789672556.473437:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564275968:12345-0@lo:400: Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672556.473442:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672556.473463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275456 00000100:00100000:0.0:1789672556.473467:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275456 00000100:00100000:0.0:1789672556.473495:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789672556.473502:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564275456:12345-0@lo:400: 00000100:00100000:0.0:1789672556.473534:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564275456:12345-0@lo:400: Request processed in 32us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672556.473540:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789672556.473597:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564275456:0@lo:400: 00000100:00100000:0.0:1789672556.473612:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564275968:0@lo:400: 00000100:00100000:0.0:1789672556.473622:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564275584:0@lo:400: 00000100:00100000:1.0:1789672556.474605:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564275840:0@lo:400: 00000100:00100000:1.0:1789672556.474664:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672556.474715:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672556.474723:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564275712:0@lo:400: 00000100:00100000:1.0:1789672556.474750:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672556.474816:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275712 00000100:00100000:1.0:1789672556.474822:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275712 00000100:00100000:1.0:1789672556.474869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672556.474877:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564275712:12345-0@lo:400: 00000100:00100000:1.0:1789672556.474924:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564275712:12345-0@lo:400: Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672556.474931:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672556.474975:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564275712:0@lo:400: 00000100:00080000:3.0:1789672556.475108:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672556.476624:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564275840 00000100:00100000:0.0:1789672556.476640:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564275840 00000100:00100000:0.0:1789672556.478564:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672556.478584:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564275840:12345-0@lo:400: 00000100:00100000:0.0:1789672556.478707:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564275840:12345-0@lo:400: Request processed in 132us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672556.478716:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789672556.484504:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e22a00 x1876607564275840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672556.484576:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564275840:0@lo:400: 00000100:00080000:2.0:1789672556.485766:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672556.713584:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672556.713633:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672556.713665:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672556.713721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672556.713762:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283328 00000100:00100000:3.0:1789672556.713777:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283328 00000100:00100000:3.0:1789672556.713893:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:3.0:1789672556.713906:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543283328:12345-192.168.202.39@tcp:400: 00000100:00100000:3.0:1789672556.714124:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543283328:12345-192.168.202.39@tcp:400: Request processed in 219us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672556.714132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00080000:3.0:1789672556.714160:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672556.714440:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283456 00000100:00100000:0.0:1789672556.714446:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283456 00000100:00100000:0.0:1789672556.714493:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283584 00000100:00100000:0.0:1789672556.714497:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283584 00000100:00100000:0.0:1789672556.714521:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672556.714528:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543283456:12345-192.168.202.39@tcp:400: 00000100:00100000:0.0:1789672556.714572:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543283456:12345-192.168.202.39@tcp:400: Request processed in 43us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672556.714579:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672556.714592:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:0.0:1789672556.714598:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543283584:12345-192.168.202.39@tcp:400: 00000100:00100000:0.0:1789672556.714623:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543283584:12345-192.168.202.39@tcp:400: Request processed in 25us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672556.714629:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00080000:0.0:1789672556.714742:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672556.714745:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672556.714972:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283200 00000100:00100000:1.0:1789672556.714978:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283200 00000100:00100000:1.0:1789672556.715024:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 128 00000100:00100000:1.0:1789672556.715031:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2358:x1876607543283200:12345-192.168.202.39@tcp:400: 00000100:00100000:1.0:1789672556.715069:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2358:x1876607543283200:12345-192.168.202.39@tcp:400: Request processed in 38us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672556.715076:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 128 00000001:02000400:3.0:1789672556.762692:0:8291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789672556.790030:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672557.812519:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672558.835647:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672559.539594:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672559.542271:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564276096:0@lo:13: 00000100:00100000:2.0:1789672559.542458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672559.545014:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564276096 00000100:00100000:0.0:1789672559.545038:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564276096 00000100:00080000:3.0:1789672559.545255:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672559.545289:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672559.545317:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564276096:12345-0@lo:13: 00002000:00000024:0.0:1789672559.545374:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672559.545499:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564276096:12345-0@lo:13: Request processed in 190us (3041us total) trans 0 rc 0/0 00010000:00080000:3.0:1789672559.545701:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e22d80 x1876607564276096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672559.545740:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564276096:0@lo:13: 00000100:00100000:0.0:1789672559.546646:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789672559.859667:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789672560.654521:0:8439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffeccb77d0 20000000:00000080:0.0:1789672560.654556:0:8439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa62f3bc800 uarg=0000000000000000 20000000:01000000:0.0:1789672560.654630:0:8439:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789672560.654634:0:8439:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789672560.654637:0:8439:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789672560.654644:0:8439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789672560.654652:0:8439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789672560.654672:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789672560.654676:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789672560.656312:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789672560.656320:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789672560.657373:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789672560.658019:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789672560.658097:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789672560.658292:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1789672560.658311:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789672560.658314:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789672560.659388:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789672560.659934:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789672560.660016:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789672560.660054:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789672560.660067:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789672560.660070:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789672560.661495:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789672560.662259:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789672560.662321:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789672560.662380:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789672560.662400:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789672560.662403:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789672560.664330:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789672560.665337:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789672560.665410:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789672560.665450:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1789672560.665471:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789672560.665498:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665521:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665530:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0871a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665538:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08744 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665557:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08752 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665564:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08760 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665572:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0877c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665580:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665591:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665598:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665606:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665662:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665683:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 9 pid: 5824 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.665703:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276224:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672560.665876:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665892:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.665902:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f526300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276352:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672560.665938:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.665947:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 18 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.665968:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276480:0@lo:104: 00000100:00100000:1.0:1789672560.666016:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672560.666064:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0877c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.666073:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0877c expref: 18 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.666082:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276608:0@lo:104: 00000100:00100000:1.0:1789672560.666109:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672560.666215:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08760 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.666224:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08760 expref: 18 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.666233:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276736:0@lo:104: 00010000:00010000:1.0:1789672560.666263:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08752 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.666282:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08752 expref: 18 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.666291:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276864:0@lo:104: 00010000:00010000:1.0:1789672560.666320:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08744 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.666328:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08744 expref: 18 pid: 5825 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.666336:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276992:0@lo:104: 00010000:00010000:1.0:1789672560.666362:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0871a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.666370:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0871a expref: 18 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.666378:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564277120:0@lo:104: 00010000:00010000:1.0:1789672560.666402:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.666411:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 18 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.666419:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564277248:0@lo:104: 00000100:00100000:1.0:1789672560.666439:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789672560.666727:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789672560.666751:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.666763:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.666776:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.666816:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.666828:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.666838:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564276480 00000100:00100000:2.0:1789672560.666848:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564276480 00000100:00100000:2.0:1789672560.666898:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564276608 00000100:00100000:2.0:1789672560.666901:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564276608 00000100:00100000:2.0:1789672560.666914:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564276736 00000100:00100000:2.0:1789672560.666916:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564276736 00000100:00100000:2.0:1789672560.666924:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564276864 00000100:00100000:2.0:1789672560.666934:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564276864 00000100:00100000:2.0:1789672560.666958:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564276992 00000100:00100000:2.0:1789672560.666961:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564276992 00000100:00100000:2.0:1789672560.666971:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277120 00000100:00100000:2.0:1789672560.666974:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277120 00000100:00100000:2.0:1789672560.666983:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277248 00000100:00100000:2.0:1789672560.666985:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277248 00000100:00100000:2.0:1789672560.666999:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672560.667008:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:8439:x1876607564276480:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667024:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667086:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672560.667093:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+9:8439:x1876607564276480:12345-0@lo:104: Request processed in 86us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667100:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672560.667120:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672560.667126:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f57e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+8:8439:x1876607564276608:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667141:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667176:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672560.667181:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f57e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+8:8439:x1876607564276608:12345-0@lo:104: Request processed in 57us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667188:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672560.667228:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672560.667234:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+7:8439:x1876607564276736:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667242:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667281:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789672560.667286:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+7:8439:x1876607564276736:12345-0@lo:104: Request processed in 53us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667293:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672560.667308:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672560.667314:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+6:8439:x1876607564276864:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667321:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667348:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789672560.667353:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+6:8439:x1876607564276864:12345-0@lo:104: Request processed in 40us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667359:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672560.667370:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789672560.667376:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:8439:x1876607564276992:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667384:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667409:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789672560.667414:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:8439:x1876607564276992:12345-0@lo:104: Request processed in 39us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667419:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789672560.667431:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672560.667436:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:8439:x1876607564277120:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667443:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667478:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789672560.667483:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:8439:x1876607564277120:12345-0@lo:104: Request processed in 48us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667490:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672560.667501:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672560.667506:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:8439:x1876607564277248:12345-0@lo:104: 00010000:00010000:2.0:1789672560.667514:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667542:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789672560.667547:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:8439:x1876607564277248:12345-0@lo:104: Request processed in 41us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.667552:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789672560.667574:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789672560.667581:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667590:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030c00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.667595:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667605:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.667614:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.667620:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.667668:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667675:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.667705:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667714:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d087a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d087ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667731:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789672560.667734:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667739:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.667742:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667748:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.667754:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.667758:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.667828:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667836:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.667842:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667858:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d0877c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08783 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667868:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789672560.667870:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667875:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee800 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.667878:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667885:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.667891:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.667896:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.667911:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667917:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.667933:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667940:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee800/0x2247cb9491d08760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08767 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667961:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789672560.667971:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667977:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.667980:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.667986:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.667992:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.667998:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.668012:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668018:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.668023:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668029:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030200/0x2247cb9491d08752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08759 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668038:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789672560.668041:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668047:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f2200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.668050:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668068:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.668075:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.668081:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.668095:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668101:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.668106:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668113:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2200/0x2247cb9491d08744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0874b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668124:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672560.668127:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668132:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ef000 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.668135:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668142:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.668148:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.668159:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.668173:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668180:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.668184:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668190:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ef000/0x2247cb9491d0871a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08721 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668202:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672560.668205:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668211:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672560.668214:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668221:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672560.668227:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672560.668233:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672560.668245:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668252:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672560.668263:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668270:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d086f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d086f7 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668286:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672560.668288:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672560.668290:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672560.668301:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672560.668319:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564277376:0@lo:103: 00000100:00100000:2.0:1789672560.668370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668411:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564277888:0@lo:103: 00000100:00100000:2.0:1789672560.668434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668458:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789672560.668463:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564277504:0@lo:103: 00000100:00100000:2.0:1789672560.668483:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668501:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564278016:0@lo:103: 00000100:00100000:2.0:1789672560.668521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668546:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564277632:0@lo:103: 00000100:00100000:2.0:1789672560.668569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668578:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564278144:0@lo:103: 00000100:00100000:2.0:1789672560.668596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668607:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672560.668611:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564277760:0@lo:103: 00000100:00100000:2.0:1789672560.668631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672560.668663:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277376 00000100:00100000:2.0:1789672560.668676:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277376 00010000:00010000:2.0:1789672560.668707:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 19 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668729:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277888 00000100:00100000:2.0:1789672560.668732:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277888 00010000:00010000:2.0:1789672560.668742:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08744 expref: 20 pid: 5825 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668753:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277504 00000100:00100000:2.0:1789672560.668756:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277504 00010000:00010000:2.0:1789672560.668765:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0877c expref: 21 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668775:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278016 00000100:00100000:2.0:1789672560.668777:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278016 00010000:00010000:2.0:1789672560.668816:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0871a expref: 22 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668829:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277632 00000100:00100000:2.0:1789672560.668832:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277632 00010000:00010000:2.0:1789672560.668845:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08760 expref: 23 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668855:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278144 00000100:00100000:2.0:1789672560.668858:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278144 00010000:00010000:2.0:1789672560.668868:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 24 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668876:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564277760 00000100:00100000:2.0:1789672560.668878:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564277760 00010000:00010000:2.0:1789672560.668886:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08752 expref: 25 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.668910:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672560.668917:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+25:3301:x1876607564277376:12345-0@lo:103: 00010000:00010000:2.0:1789672560.668932:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.668938:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 25 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668960:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 25 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.668983:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669017:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+25:3301:x1876607564277376:12345-0@lo:103: Request processed in 100us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669024:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672560.669040:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672560.669045:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+24:3301:x1876607564277888:12345-0@lo:103: 00010000:00010000:2.0:1789672560.669053:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.669057:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08744 expref: 24 pid: 5825 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669065:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08744 expref: 24 pid: 5825 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669075:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669094:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+24:3301:x1876607564277888:12345-0@lo:103: Request processed in 49us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669100:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672560.669111:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672560.669124:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+23:3301:x1876607564277504:12345-0@lo:103: 00010000:00010000:2.0:1789672560.669131:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.669136:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0877c expref: 23 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669144:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0877c expref: 23 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669152:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669172:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+23:3301:x1876607564277504:12345-0@lo:103: Request processed in 49us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669178:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672560.669191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672560.669196:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+22:3301:x1876607564278016:12345-0@lo:103: 00010000:00010000:2.0:1789672560.669203:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.669208:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0871a expref: 22 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669216:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0871a expref: 22 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669225:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669244:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+22:3301:x1876607564278016:12345-0@lo:103: Request processed in 49us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669250:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672560.669260:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789672560.669265:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+21:3299:x1876607564277632:12345-0@lo:103: 00010000:00010000:2.0:1789672560.669274:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.669285:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08760 expref: 21 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669293:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08760 expref: 21 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669303:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669329:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+21:3299:x1876607564277632:12345-0@lo:103: Request processed in 64us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669336:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789672560.669349:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672560.669354:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+20:3299:x1876607564278144:12345-0@lo:103: 00010000:00010000:2.0:1789672560.669363:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.669367:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 20 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669375:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 20 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669384:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669402:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+20:3299:x1876607564278144:12345-0@lo:103: Request processed in 48us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669408:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672560.669421:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672560.669427:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564277760:12345-0@lo:103: 00010000:00010000:2.0:1789672560.669435:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.669439:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08752 expref: 19 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669457:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08752 expref: 19 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.669467:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.669488:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564277760:12345-0@lo:103: Request processed in 61us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.669494:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672560.669571:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564277760:0@lo:103: 00000100:00100000:2.0:1789672560.669581:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564277632:0@lo:103: 00000100:00100000:2.0:1789672560.669588:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564278144:0@lo:103: 00000100:00100000:2.0:1789672560.669615:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564277504:0@lo:103: 00000100:00100000:2.0:1789672560.669623:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564278016:0@lo:103: 00000100:00100000:2.0:1789672560.669630:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564277376:0@lo:103: 00000100:00100000:2.0:1789672560.669637:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564277888:0@lo:103: 00010000:00010000:1.0:1789672560.669817:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031a00/0x2247cb9491d087ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d087a6 expref: 18 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669845:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276480:0@lo:104: 00010000:00010000:1.0:1789672560.669859:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030800/0x2247cb9491d08783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0877c expref: 17 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669867:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276608:0@lo:104: 00010000:00010000:1.0:1789672560.669875:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421eec00/0x2247cb9491d08767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08760 expref: 16 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669883:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276736:0@lo:104: 00010000:00010000:1.0:1789672560.669892:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421ee000/0x2247cb9491d08759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08752 expref: 15 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669900:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276864:0@lo:104: 00010000:00010000:1.0:1789672560.669909:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031400/0x2247cb9491d0874b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08744 expref: 14 pid: 5825 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669916:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276992:0@lo:104: 00010000:00010000:1.0:1789672560.669925:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0871a expref: 13 pid: 5824 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669934:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564277120:0@lo:104: 00010000:00010000:1.0:1789672560.669943:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929ea00/0x2247cb9491d086f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d086f0 expref: 12 pid: 5823 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672560.669965:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564277248:0@lo:104: 00000100:00100000:1.0:1789672560.672768:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276224:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672560.672985:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f526300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1876607564276352:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672560.673049:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672560.674146:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672560.674233:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283712 00000100:00100000:2.0:1789672560.674244:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283712 00010000:00010000:2.0:1789672560.674292:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 10 pid: 5824 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.674343:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:2.0:1789672560.674357:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2357:x1876607543283712:12345-192.168.202.39@tcp:103: 00010000:00010000:2.0:1789672560.674377:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.674384:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 10 pid: 5824 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.674415:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 10 pid: 5824 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.674446:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030a00/0x2247cb9491d087c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6b1 expref: 10 pid: 5824 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.674465:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.674534:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:2357:x1876607543283712:12345-192.168.202.39@tcp:103: Request processed in 179us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.674541:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:0.0:1789672560.677919:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672560.678066:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283840 00000100:00100000:2.0:1789672560.678080:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283840 00010000:00010000:2.0:1789672560.678136:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672560.678191:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:2.0:1789672560.678202:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:2358:x1876607543283840:12345-192.168.202.39@tcp:103: 00010000:00010000:2.0:1789672560.678221:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672560.678228:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678243:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678265:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929e200/0x2247cb9491d087bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6aa expref: 9 pid: 5823 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678296:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678328:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678348:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678357:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678364:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678372:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678380:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f3400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672560.678385:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.678395:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.685396:0:8439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672560.685421:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.687050:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.687074:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3400/0x2247cb9491d087fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672560.687104:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672560.687254:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:2358:x1876607543283840:12345-192.168.202.39@tcp:103: Request processed in 9045us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672560.687281:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00010000:00010000:2.0:1789672560.884983:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672561.257123:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672561.258474:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543283968 00000100:00100000:0.0:1789672561.258491:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543283968 00000100:00100000:0.0:1789672561.258582:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 129 00000100:00100000:0.0:1789672561.258594:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:5598:x1876607543283968:12345-192.168.202.39@tcp:101: 00010000:00010000:0.0:1789672561.258620:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672561.258648:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031400/0x2247cb9491d08801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf713 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672561.258685:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031400/0x2247cb9491d08801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf713 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672561.258720:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031400/0x2247cb9491d08801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf713 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672561.258731:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031400, rc 0) 00000100:00100000:0.0:1789672561.258845:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543283968:12345-192.168.202.39@tcp:101: Request processed in 252us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.258852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 129 00000100:00100000:3.0:1789672561.261644:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672561.261834:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284096 00000100:00100000:0.0:1789672561.261848:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284096 00000100:00100000:0.0:1789672561.262112:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 130 00000100:00100000:0.0:1789672561.262135:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543284096:12345-192.168.202.39@tcp:501: 00000100:00100000:0.0:1789672561.262598:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543284096:12345-192.168.202.39@tcp:501: Request processed in 474us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.262607:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 130 00000100:00100000:3.0:1789672561.265164:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672561.265325:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284224 00000100:00100000:2.0:1789672561.265338:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284224 00000100:00100000:0.0:1789672561.265416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 131 00000100:00100000:0.0:1789672561.265433:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543284224:12345-192.168.202.39@tcp:503: 00000100:00100000:0.0:1789672561.265754:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543284224:12345-192.168.202.39@tcp:503: Request processed in 326us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.265862:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 131 00000100:00100000:3.0:1789672561.273783:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672561.276032:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284352 00000100:00100000:0.0:1789672561.276054:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284352 00000100:00100000:0.0:1789672561.276162:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 132 00000100:00100000:0.0:1789672561.276176:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:6065:x1876607543284352:12345-192.168.202.39@tcp:502: 00000100:00100000:0.0:1789672561.276917:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:6065:x1876607543284352:12345-192.168.202.39@tcp:502: Request processed in 740us (5502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.276940:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 132 00000100:00100000:3.0:1789672561.286352:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672561.286428:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284480 00000100:00100000:2.0:1789672561.286444:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284480 00000100:00100000:2.0:1789672561.286562:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 133 00000100:00100000:2.0:1789672561.286577:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:6065:x1876607543284480:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672561.287042:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:6065:x1876607543284480:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 468us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672561.287050:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 133 00000100:00100000:3.0:1789672561.294377:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672561.296218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284608 00000100:00100000:1.0:1789672561.296236:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284608 00000100:00100000:1.0:1789672561.296317:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 134 00000100:00100000:1.0:1789672561.296330:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543284608:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672561.296355:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672561.296380:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf71a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672561.296538:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf71a expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672561.296668:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf71a expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672561.296679:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f2400, rc 0) 00000100:00100000:1.0:1789672561.296890:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543284608:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 561us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.296898:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 134 00000100:00100000:3.0:1789672561.304352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672561.304657:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284736 00000100:00100000:2.0:1789672561.304672:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284736 00000100:00100000:2.0:1789672561.304839:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 135 00000100:00100000:2.0:1789672561.304852:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543284736:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672561.305665:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543284736:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 810us (1325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672561.305676:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 135 00000100:00100000:1.0:1789672561.587057:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564278400:0@lo:400: 00000100:00100000:0.0:1789672561.587167:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564278528:0@lo:400: 00000100:00100000:1.0:1789672561.587216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672561.587232:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564278784:0@lo:400: 00000100:00100000:2.0:1789672561.587290:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564278656:0@lo:400: 00000100:00100000:0.0:1789672561.591881:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672561.591990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672561.592016:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564278272:0@lo:13: 00000100:00100000:1.0:1789672561.592055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672561.592151:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564278912:0@lo:400: 00000100:00100000:1.0:1789672561.592172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672561.592177:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564279040:0@lo:400: 00000100:00100000:1.0:1789672561.592227:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278400 00000100:00100000:0.0:1789672561.592229:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278272 00000100:00100000:1.0:1789672561.592240:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278400 00000100:00100000:0.0:1789672561.592240:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278272 00000100:00100000:1.0:1789672561.592307:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789672561.592309:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672561.592322:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3300:x1876607564278400:12345-0@lo:400: 00000100:00100000:0.0:1789672561.592328:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564278272:12345-0@lo:13: 00002000:00000024:0.0:1789672561.592379:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672561.592386:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:3300:x1876607564278400:12345-0@lo:400: Request processed in 68us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.592393:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789672561.592444:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564278400:0@lo:400: 00000100:00100000:1.0:1789672561.592485:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278528 00000100:00100000:1.0:1789672561.592488:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278528 00000100:00100000:1.0:1789672561.592509:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278912 00000100:00100000:1.0:1789672561.592512:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278912 00000100:00100000:1.0:1789672561.592533:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789672561.592540:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564278528:12345-0@lo:400: 00000100:00100000:0.0:1789672561.592850:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564278272:12345-0@lo:13: Request processed in 530us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.592858:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564278528:12345-0@lo:400: Request processed in 316us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.592865:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672561.592871:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789672561.592892:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789672561.592903:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564278912:12345-0@lo:400: 00000100:00100000:0.0:1789672561.592905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672561.592960:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564278912:12345-0@lo:400: Request processed in 61us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.592966:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564278528:0@lo:400: 00000100:00100000:1.0:1789672561.592984:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672561.592995:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278784 00000100:00100000:0.0:1789672561.593011:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278784 00000100:00100000:1.0:1789672561.593021:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564278912:0@lo:400: 00010000:00080000:1.0:1789672561.593033:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e20380 x1876607564278272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672561.593049:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564278272:0@lo:13: 00000100:00100000:0.0:1789672561.593052:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279040 00000100:00100000:0.0:1789672561.593056:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279040 00000100:00100000:1.0:1789672561.593081:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672561.593095:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672561.593105:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564279040:12345-0@lo:400: 00000100:00100000:0.0:1789672561.593145:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564279040:12345-0@lo:400: Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672561.593152:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672561.593168:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564278784:12345-0@lo:400: 00010000:00080000:0.0:1789672561.593184:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e54700 x1876607564279040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672561.593196:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564279040:0@lo:400: 00000100:00100000:1.0:1789672561.593200:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564278784:12345-0@lo:400: Request processed in 113us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.593211:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789672561.595629:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672561.595643:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672561.595647:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672561.596317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672561.596579:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564278656 00000100:00100000:2.0:1789672561.596591:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564278656 00000100:00080000:0.0:1789672561.596853:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672561.596911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789672561.596925:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564278656:12345-0@lo:400: 00000100:00100000:1.0:1789672561.597040:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564278656:12345-0@lo:400: Request processed in 118us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.597049:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672561.597244:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564278656:0@lo:400: 00010000:00080000:3.0:1789672561.600140:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e54380 x1876607564278784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672561.600163:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564278784:0@lo:400: 00000100:00100000:2.0:1789672561.833760:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672561.833911:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672561.833988:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672561.834043:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284864 00000100:00100000:3.0:1789672561.834059:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284864 00000100:00100000:3.0:1789672561.834186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:3.0:1789672561.834199:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543284864:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672561.834318:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543284864:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 121us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672561.834326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00080000:1.0:1789672561.836138:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672561.845031:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543284992 00000100:00100000:0.0:1789672561.845056:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543284992 00000100:00080000:2.0:1789672561.845462:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672561.845692:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285120 00000100:00100000:0.0:1789672561.845698:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285120 00000100:00080000:3.0:1789672561.845775:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672561.845883:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672561.845899:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543284992:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672561.846023:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543284992:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 128us (12278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.846031:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672561.846052:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:1.0:1789672561.846060:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543285120:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672561.846108:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543285120:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 49us (12120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672561.846115:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00010000:00010000:2.0:1789672561.909911:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789672562.240444:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789672562.240456:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa63fb87000 from 39 10000000:01000000:2.0:1789672562.240464:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672562.240529:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.240545:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.240560:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.240591:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279168:0@lo:101: 00000100:00100000:2.0:1789672562.240690:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672562.240760:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a60cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.240863:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279168 00000100:00100000:0.0:1789672562.240876:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279168 00000100:00100000:0.0:1789672562.240959:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789672562.240972:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+12:5827:x1876607564279168:12345-0@lo:101: 00010000:00010000:0.0:1789672562.240989:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672562.241004:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600030800/0x2247cb9491d08816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0880f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.241031:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030800/0x2247cb9491d08816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0880f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.241044:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600030800/0x2247cb9491d08816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0880f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.241055:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600030800, rc 0) 00000100:00100000:0.0:1789672562.241100:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564279168:12345-0@lo:101: Request processed in 130us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.241106:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789672562.241205:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279168:0@lo:101: 00010000:00010000:2.0:1789672562.241223:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.241233:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.241307:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279296:0@lo:501: 00000100:00100000:2.0:1789672562.241334:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672562.241366:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a60cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.241418:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279296 00000100:00100000:0.0:1789672562.241423:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279296 00000100:00100000:0.0:1789672562.241454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789672562.241461:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564279296:12345-0@lo:501: 00000100:00100000:0.0:1789672562.241849:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564279296:12345-0@lo:501: Request processed in 387us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.241864:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789672562.241993:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279296:0@lo:501: 00000100:00100000:2.0:1789672562.242048:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279424:0@lo:503: 00000100:00100000:2.0:1789672562.242091:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672562.242105:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a60cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.243379:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279424 00000100:00100000:0.0:1789672562.243393:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279424 00000100:00100000:0.0:1789672562.243451:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789672562.243462:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564279424:12345-0@lo:503: 00000100:00100000:0.0:1789672562.243751:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564279424:12345-0@lo:503: Request processed in 290us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.243758:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789672562.243931:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279424:0@lo:503: 00000100:00100000:3.0:1789672562.244382:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8462:1876607564279552:0@lo:502: 00000100:00100000:3.0:1789672562.244435:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.244515:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.248500:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279552 00000100:00100000:2.0:1789672562.248524:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279552 00000100:00100000:2.0:1789672562.248612:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789672562.248626:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:8462:x1876607564279552:12345-0@lo:502: 00000100:00100000:2.0:1789672562.249103:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:8462:x1876607564279552:12345-0@lo:502: Request processed in 479us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.249112:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789672562.249260:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8462:1876607564279552:0@lo:502: 00000100:00100000:3.0:1789672562.249501:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8462:1876607564279680:0@lo:502: 00000100:00100000:3.0:1789672562.249686:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.249731:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.251375:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279680 00000100:00100000:2.0:1789672562.251399:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279680 00000100:00100000:2.0:1789672562.251564:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789672562.251578:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:8462:x1876607564279680:12345-0@lo:502: 00000100:00100000:2.0:1789672562.252008:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:8462:x1876607564279680:12345-0@lo:502: Request processed in 432us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.252018:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789672562.253531:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8462:1876607564279680:0@lo:502: 00000040:00080000:3.0:1789672562.253599:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789672562.257127:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789672562.257189:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672562.257208:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.257226:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672562.257242:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789672562.257246:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789672562.257250:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789672562.257338:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.257349:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.257363:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.257399:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279808:0@lo:101: 00000100:00100000:2.0:1789672562.257506:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672562.257564:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a60cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.257602:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279808 00000100:00100000:0.0:1789672562.257614:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279808 00000100:00100000:0.0:1789672562.257689:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789672562.257701:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+13:5827:x1876607564279808:12345-0@lo:101: 00010000:00010000:0.0:1789672562.257717:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672562.257733:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031a00/0x2247cb9491d08824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0881d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.257762:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031a00/0x2247cb9491d08824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0881d expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.257774:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031a00/0x2247cb9491d08824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0881d expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.257819:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031a00, rc 0) 00000100:00100000:0.0:1789672562.257875:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564279808:12345-0@lo:101: Request processed in 177us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.257883:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789672562.258107:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279808:0@lo:101: 00010000:00010000:3.0:1789672562.258135:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.258145:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672562.258219:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279936:0@lo:501: 00000100:00100000:3.0:1789672562.258251:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.258292:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.258607:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564279936 00000100:00100000:2.0:1789672562.258614:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564279936 00000100:00100000:2.0:1789672562.258658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789672562.258666:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564279936:12345-0@lo:501: 00000100:00100000:2.0:1789672562.259185:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564279936:12345-0@lo:501: Request processed in 518us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.259194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789672562.260326:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564279936:0@lo:501: 00000100:00100000:3.0:1789672562.260396:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280064:0@lo:503: 00000100:00100000:3.0:1789672562.260477:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.260528:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.260908:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280064 00000100:00100000:2.0:1789672562.260917:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280064 00000100:00100000:2.0:1789672562.261021:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789672562.261032:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564280064:12345-0@lo:503: 00000100:00100000:2.0:1789672562.261279:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564280064:12345-0@lo:503: Request processed in 248us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.261287:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789672562.261381:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280064:0@lo:503: 00000100:00100000:3.0:1789672562.263137:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8463:1876607564280192:0@lo:502: 00000100:00100000:3.0:1789672562.263246:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.273022:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.275352:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280192 00000100:00100000:0.0:1789672562.275375:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280192 00000100:00100000:0.0:1789672562.276013:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789672562.276025:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8463:x1876607564280192:12345-0@lo:502: 00000100:00100000:0.0:1789672562.276538:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8463:x1876607564280192:12345-0@lo:502: Request processed in 514us (13290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.276558:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789672562.277002:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8463:1876607564280192:0@lo:502: 00000020:01000000:3.0:1789672562.277053:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672562.277068:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672562.277071:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789672562.277080:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789672562.277140:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8463:1876607564280320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.277203:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.277240:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.277429:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280320 00000100:00100000:0.0:1789672562.277437:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280320 00000100:00100000:0.0:1789672562.277690:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789672562.277698:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8463:x1876607564280320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.277967:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:8463:x1876607564280320:12345-0@lo:502:llog_process_th.0 Request processed in 268us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.277975:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789672562.278089:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8463:1876607564280320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789672562.278125:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672562.278132:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672562.278134:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789672562.278139:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789672562.278870:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789672562.278900:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789672562.278914:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.278928:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672562.278951:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789672562.278955:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa6117c1000 from 39 10000000:01000000:0.0:1789672562.278959:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789672562.279001:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.279011:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.279039:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.279064:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.279192:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.279240:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672562.279521:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280448 00000100:00100000:1.0:1789672562.279530:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280448 00000100:00100000:1.0:1789672562.279691:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789672562.279703:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:5827:x1876607564280448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672562.279728:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672562.279747:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f2a00/0x2247cb9491d08832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0882b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.279779:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f2a00/0x2247cb9491d08832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0882b expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.279808:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f2a00/0x2247cb9491d08832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0882b expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.279819:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f2a00, rc 0) 00000100:00100000:1.0:1789672562.279881:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564280448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672562.279888:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789672562.279980:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672562.279994:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.280003:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.280062:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.280087:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.282952:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.283049:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280576 00000100:00100000:3.0:1789672562.283065:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280576 00000100:00100000:3.0:1789672562.283235:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789672562.283246:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564280576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.283946:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564280576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 688us (3843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.283956:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789672562.284095:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.284239:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672562.284634:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672562.284676:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.284725:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280704 00000100:00100000:3.0:1789672562.284731:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280704 00000100:00100000:3.0:1789672562.284768:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789672562.284775:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564280704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.285008:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564280704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.285016:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789672562.285211:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564280704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.286197:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8464:1876607564280832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.286335:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.286415:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.286549:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280832 00000100:00100000:3.0:1789672562.286557:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280832 00000100:00100000:3.0:1789672562.286647:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789672562.286657:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8464:x1876607564280832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.289986:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8464:x1876607564280832:12345-0@lo:502:llog_process_th.0 Request processed in 3316us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.290005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789672562.290344:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8464:1876607564280832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.290657:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8464:1876607564280960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.290722:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.290830:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604c9b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.290898:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564280960 00000100:00100000:3.0:1789672562.290906:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564280960 00000100:00100000:3.0:1789672562.290967:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789672562.290977:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8464:x1876607564280960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.291508:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:8464:x1876607564280960:12345-0@lo:502:llog_process_th.0 Request processed in 531us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.291517:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789672562.291662:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8464:1876607564280960:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789672562.291688:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789672562.291834:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789672562.291860:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672562.291874:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.291895:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672562.291907:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789672562.291910:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789672562.291914:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789672562.291959:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.291968:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.291979:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.291999:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672562.292038:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672562.292119:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672562.294100:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281088 00000100:00100000:1.0:1789672562.297207:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281088 00000100:00100000:1.0:1789672562.297550:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789672562.297568:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:5827:x1876607564281088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672562.297594:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672562.297644:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d08840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08839 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.297686:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d08840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08839 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.297701:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d08840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08839 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.297712:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f3200, rc 0) 00000100:00100000:1.0:1789672562.297867:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564281088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (5827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672562.297874:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789672562.298018:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672562.298045:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.298055:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.298163:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672562.298206:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.298344:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281216 00000100:00100000:0.0:1789672562.298350:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281216 00000100:00100000:0.0:1789672562.298390:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789672562.298398:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564281216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.298744:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564281216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.298751:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789672562.299207:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672562.299228:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672562.299335:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672562.299385:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672562.299420:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.299505:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281344 00000100:00100000:0.0:1789672562.299510:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281344 00000100:00100000:0.0:1789672562.299547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789672562.299553:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564281344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.299732:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564281344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.299739:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789672562.299871:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672562.300393:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8465:1876607564281472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672562.300492:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672562.300527:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.305324:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281472 00000100:00100000:2.0:1789672562.305351:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281472 00000100:00100000:2.0:1789672562.305453:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789672562.305466:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8465:x1876607564281472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672562.305879:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8465:x1876607564281472:12345-0@lo:502:llog_process_th.0 Request processed in 414us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.305888:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789672562.306395:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8465:1876607564281472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672562.306444:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672562.306454:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672562.306456:0:8465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789672562.306461:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789672562.306509:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8465:1876607564281600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672562.306550:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672562.306601:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.306626:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281600 00000100:00100000:2.0:1789672562.306633:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281600 00000100:00100000:2.0:1789672562.306675:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789672562.306683:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8465:x1876607564281600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672562.307045:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:8465:x1876607564281600:12345-0@lo:502:llog_process_th.0 Request processed in 360us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.307052:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789672562.307151:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8465:1876607564281600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672562.307168:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672562.307171:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672562.307172:0:8465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789672562.307176:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789672562.307266:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789672562.307294:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789672562.307307:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.307320:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672562.307333:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789672562.307336:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa604b25800 from 39 10000000:01000000:3.0:1789672562.307349:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672562.307382:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.307391:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.307402:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672562.307418:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.307456:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.307527:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.307622:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281728 00000100:00100000:0.0:1789672562.307628:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281728 00000100:00100000:0.0:1789672562.307668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789672562.307676:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564281728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672562.307688:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672562.307705:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600030200/0x2247cb9491d0884e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08847 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.307741:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030200/0x2247cb9491d0884e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08847 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.307753:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600030200/0x2247cb9491d0884e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08847 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.307764:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600030200, rc 0) 00000100:00100000:0.0:1789672562.307884:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564281728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.307891:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789672562.307990:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672562.308005:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.308015:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672562.308067:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.308094:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.308164:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.308198:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281856 00000100:00100000:2.0:1789672562.308203:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281856 00000100:00100000:2.0:1789672562.308262:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789672562.308270:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564281856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672562.308571:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564281856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.308579:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789672562.308647:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.308680:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.308717:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.308910:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.308982:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564281984 00000100:00100000:0.0:1789672562.308988:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564281984 00000100:00100000:0.0:1789672562.309017:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789672562.309024:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564281984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.309202:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564281984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.309209:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789672562.309286:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564281984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.309651:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8466:1876607564282112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.309691:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.309716:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.309849:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282112 00000100:00100000:0.0:1789672562.309855:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282112 00000100:00100000:0.0:1789672562.309875:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789672562.309881:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8466:x1876607564282112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.310077:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8466:x1876607564282112:12345-0@lo:502:llog_process_th.0 Request processed in 195us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.310084:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789672562.310171:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8466:1876607564282112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.310215:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8466:1876607564282240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.310248:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.310281:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672562.310333:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282240 00000100:00100000:0.0:1789672562.310337:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282240 00000100:00100000:0.0:1789672562.310364:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789672562.310371:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8466:x1876607564282240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.310504:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8466:x1876607564282240:12345-0@lo:502:llog_process_th.0 Request processed in 133us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.310511:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789672562.310627:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8466:1876607564282240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789672562.310648:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789672562.310963:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789672562.310983:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672562.310995:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.311008:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672562.311020:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789672562.311024:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789672562.311027:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789672562.311058:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.311067:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.311077:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.311092:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564282368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.311124:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.311187:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.311218:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282368 00000100:00100000:3.0:1789672562.311223:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282368 00000100:00100000:3.0:1789672562.311289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789672562.311297:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564282368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672562.311308:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672562.311321:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67d000/0x2247cb9491d0885c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08855 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.311344:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67d000/0x2247cb9491d0885c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08855 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.311355:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67d000/0x2247cb9491d0885c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08855 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.311363:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d000, rc 0) 00000100:00100000:3.0:1789672562.311405:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564282368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.311420:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789672562.311476:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564282368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672562.311497:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.311507:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.311571:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564282496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.311598:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.311715:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.311742:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282496 00000100:00100000:3.0:1789672562.311746:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282496 00000100:00100000:3.0:1789672562.311764:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789672562.311769:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564282496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.312075:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564282496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.312082:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789672562.312566:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564282496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.312611:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564282624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.312657:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.312692:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.312829:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282624 00000100:00100000:3.0:1789672562.312835:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282624 00000100:00100000:3.0:1789672562.312863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789672562.312869:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564282624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672562.313044:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564282624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.313050:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789672562.313342:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564282624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.318929:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8467:1876607564282752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.319052:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.319106:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.319202:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282752 00000100:00100000:2.0:1789672562.319213:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282752 00000100:00100000:3.0:1789672562.319357:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789672562.319372:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8467:x1876607564282752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672562.319692:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8467:x1876607564282752:12345-0@lo:502:llog_process_th.0 Request processed in 324us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.319701:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789672562.320248:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8467:1876607564282752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672562.320357:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672562.320370:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672562.320373:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789672562.320381:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789672562.320479:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8467:1876607564282880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672562.320533:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.320621:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d39a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.329072:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564282880 00000100:00100000:2.0:1789672562.329096:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564282880 00000100:00100000:2.0:1789672562.329264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789672562.329406:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8467:x1876607564282880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672562.329780:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8467:x1876607564282880:12345-0@lo:502:llog_process_th.0 Request processed in 377us (9245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672562.334521:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8467:1876607564282880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672562.334587:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672562.334601:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672562.334604:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789672562.334610:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789672562.339883:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789672562.339956:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789672562.339975:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.339993:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672562.340009:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789672562.340013:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa6103db380 from 1 10000000:01000000:1.0:1789672562.340017:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789672562.340072:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.340082:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.340189:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672562.340226:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564283008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672562.340470:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789672562.340620:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672562.340685:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672562.341470:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283008 00000100:00100000:3.0:1789672562.341483:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283008 00000100:00100000:3.0:1789672562.341542:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789672562.341554:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564283008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672562.341573:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672562.341602:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d0886a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08863 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.341636:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d0886a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08863 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.341650:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d0886a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08863 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.341659:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c600, rc 0) 00000100:00100000:3.0:1789672562.342509:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564283008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 953us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.342521:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789672562.343594:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564283008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672562.343627:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.343642:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.349011:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564283136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672562.349113:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.349151:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602d390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672562.349427:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283136 00000100:00100000:2.0:1789672562.349444:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283136 00000100:00100000:2.0:1789672562.349526:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789672562.349538:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564283136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672562.349955:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564283136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 418us (840us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672562.349965:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789672562.349986:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564283136:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789672562.350041:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789672562.350063:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.350076:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789672562.881708:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed4ab9ad0 20000000:00000080:3.0:1789672562.881732:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa62f570400 uarg=0000000000000000 20000000:01000000:3.0:1789672562.881783:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789672562.881827:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789672562.881834:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789672562.887730:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789672562.888387:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789672562.901535:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789672562.901591:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789672562.901638:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789672562.901657:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789672562.901681:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.901704:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d085df expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.901714:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.901721:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0870c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.901741:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.901750:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.905080:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.905115:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 9 pid: 5823 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672562.905136:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283264:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672562.905316:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0870c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.905326:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0870c expref: 18 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672562.905337:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283392:0@lo:104: 00000100:00100000:1.0:1789672562.905390:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672562.905439:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.905448:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.905451:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283392 00000100:00100000:1.0:1789672562.905460:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283520:0@lo:104: 00000100:00100000:2.0:1789672562.905462:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283392 00000100:00100000:1.0:1789672562.905517:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672562.905538:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d085df expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.905543:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789672562.905548:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d085df expref: 18 pid: 5824 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.905559:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283520 00000100:00100000:1.0:1789672562.905560:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283648:0@lo:104: 00000100:00100000:2.0:1789672562.905565:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283520 00000100:00100000:2.0:1789672562.905593:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672562.905594:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672562.905610:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:8497:x1876607564283392:12345-0@lo:104: 00000100:00100000:1.0:1789672562.905611:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a729540 going to sleep for 11 seconds 00010000:00010000:2.0:1789672562.905629:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.905722:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672562.905740:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:8497:x1876607564283392:12345-0@lo:104: Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.905748:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789672562.905768:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283648 00000100:00100000:2.0:1789672562.905772:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283648 00000100:00100000:0.0:1789672562.905819:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789672562.906132:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:8497:x1876607564283520:12345-0@lo:104: 00010000:00010000:0.0:1789672562.906143:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.906193:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789672562.906200:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:8497:x1876607564283520:12345-0@lo:104: Request processed in 77us (683us total) trans 0 rc 0/0 00010000:00010000:2.0:1789672562.906295:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672562.906303:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.906312:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f3000 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672562.906318:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.906328:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672562.906337:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672562.906344:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672562.906533:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.906540:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789672562.906546:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672562.906585:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.906590:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789672562.906599:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3000/0x2247cb9491d0870c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08713 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.906604:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:8497:x1876607564283648:12345-0@lo:104: 00010000:00010000:0.0:1789672562.906618:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.906621:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672562.906628:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.906636:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f2000 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672562.906640:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.906658:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672562.906664:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:8497:x1876607564283648:12345-0@lo:104: Request processed in 65us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.906678:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789672562.906695:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789672562.906716:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672562.906729:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564283776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672562.906769:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672562.906919:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283392:0@lo:104: 00000100:00100000:1.0:1789672562.906941:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283520:0@lo:104: 00000100:00100000:1.0:1789672562.906949:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283648:0@lo:104: 00000100:00100000:0.0:1789672562.907311:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283776 00000100:00100000:0.0:1789672562.907319:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283776 00010000:00010000:0.0:1789672562.907349:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0870c expref: 19 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.907384:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672562.907393:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564283776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672562.907405:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672562.907411:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0870c expref: 19 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.907421:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0870c expref: 19 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.907438:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421efa00/0x2247cb9491d08713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0870c expref: 19 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.907456:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672562.907493:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3301:x1876607564283776:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.907499:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672562.907531:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564283776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672562.908082:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.908089:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672562.908094:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789672562.908098:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.908098:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789672562.908106:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672562.908148:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.908155:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672562.908184:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.908192:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08648 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.908208:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672562.908211:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672562.908213:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672562.908238:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564283904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672562.908425:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672562.908521:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564283904 00000100:00100000:3.0:1789672562.908529:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564283904 00010000:00010000:3.0:1789672562.908554:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672562.908591:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789672562.908599:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3299:x1876607564283904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672562.908609:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672562.908614:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.908641:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.908655:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929fc00/0x2247cb9491d08648 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08641 expref: 18 pid: 5823 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.908666:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672562.908711:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3299:x1876607564283904:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672562.908718:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672562.908839:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564283904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672562.909052:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.909067:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030e00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672562.909071:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.909080:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672562.909086:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672562.909092:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672562.909349:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.909358:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789672562.909407:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564284032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672562.909453:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672562.909530:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284032 00000100:00100000:0.0:1789672562.909537:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284032 00010000:00010000:0.0:1789672562.909564:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d085df expref: 17 pid: 5824 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672562.909592:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789672562.909600:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3300:x1876607564284032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672562.909611:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672562.909616:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d085df expref: 17 pid: 5824 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.909626:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d085df expref: 17 pid: 5824 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.909638:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031800/0x2247cb9491d085e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d085df expref: 17 pid: 5824 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672562.909650:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672562.909701:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.909709:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d085df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d085e6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672562.909736:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672562.909738:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672562.909740:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672562.910001:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3300:x1876607564284032:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.910009:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789672562.910056:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564284032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672562.911360:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1876607564283264:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672562.911420:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672562.912979:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672562.913186:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285248 00000100:00100000:1.0:1789672562.913198:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285248 00010000:00010000:1.0:1789672562.913309:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 10 pid: 5823 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672562.913411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:1.0:1789672562.913423:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2357:x1876607543285248:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672562.913442:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672562.913449:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 10 pid: 5823 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913462:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 10 pid: 5823 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913484:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421ee400/0x2247cb9491d087d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6e2 expref: 10 pid: 5823 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913505:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913516:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913537:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913546:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913553:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913561:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913580:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f3600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672562.913585:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913595:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913618:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.913631:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672562.913780:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.913807:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672562.913814:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d08871 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672562.915329:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:2357:x1876607543285248:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 1894us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672562.915344:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 24 00010000:00010000:0.0:1789672562.954364:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672562.957532:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672562.958048:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285376 00000100:00100000:1.0:1789672562.958062:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285376 00000100:00100000:1.0:1789672562.958161:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 169 00000100:00100000:1.0:1789672562.958174:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:5598:x1876607543285376:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672562.958211:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672562.958251:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf721 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.958290:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.958303:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672562.958325:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f2000, rc 0) 00000100:00100000:1.0:1789672562.958409:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543285376:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 237us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672562.958417:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 169 00000100:00100000:0.0:1789672562.964026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672562.964132:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285504 00000100:00100000:2.0:1789672562.964146:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285504 00000100:00100000:2.0:1789672562.964215:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 170 00000100:00100000:2.0:1789672562.964227:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543285504:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672562.964618:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543285504:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 392us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672562.964627:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 170 00000100:00100000:0.0:1789672562.977101:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672562.977294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285632 00000100:00100000:1.0:1789672562.977308:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285632 00000100:00100000:1.0:1789672562.977383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 171 00000100:00100000:1.0:1789672562.977395:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543285632:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672562.977709:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:5598:x1876607543285632:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 314us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672562.977718:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 171 00000100:00100000:3.0:1789672562.996051:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672562.996145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285760 00000100:00100000:0.0:1789672562.996159:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285760 00000100:00100000:0.0:1789672562.996239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 172 00000100:00100000:0.0:1789672562.996251:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:6088:x1876607543285760:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789672562.996580:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:6088:x1876607543285760:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 331us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672562.996589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 172 00000100:00100000:3.0:1789672563.007511:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672563.007565:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543285888 00000100:00100000:3.0:1789672563.007580:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543285888 00000100:00100000:3.0:1789672563.007649:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 173 00000100:00100000:3.0:1789672563.007662:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:6088:x1876607543285888:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672563.008021:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:6088:x1876607543285888:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 360us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672563.008031:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 173 10000000:01000000:3.0:1789672563.954894:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789672563.954906:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa63fb87000 from 4 10000000:01000000:3.0:1789672563.954911:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672563.955725:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672563.955742:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672563.955757:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672563.955849:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672563.955946:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672563.956009:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672563.956243:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284160 00000100:00100000:3.0:1789672563.956253:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284160 00000100:00100000:3.0:1789672563.956321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789672563.956332:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564284160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672563.956350:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672563.956369:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0887f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672563.956400:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0887f expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672563.956413:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0887f expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672563.956423:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ca00, rc 0) 00000100:00100000:3.0:1789672563.956484:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564284160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672563.956491:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00010000:2.0:1789672563.956838:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672563.957511:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672563.957543:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672563.957557:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672563.957663:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672563.957722:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672563.957780:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610e1d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672563.959001:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284288 00000100:00100000:2.0:1789672563.959016:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284288 00000100:00100000:2.0:1789672563.959077:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789672563.959088:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564284288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672563.959491:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564284288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 404us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672563.959501:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789672563.959712:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672563.959822:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672563.959881:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672563.959916:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672563.959995:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284416 00000100:00100000:1.0:1789672563.960001:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284416 00000100:00100000:1.0:1789672563.960048:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789672563.960056:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564284416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672563.961233:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564284416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1168us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672563.961247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789672563.961439:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672564.003596:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8531:1876607564284544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672564.003711:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672564.003764:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa607aff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.007070:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284544 00000100:00100000:0.0:1789672564.007094:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284544 00000100:00100000:0.0:1789672564.007190:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789672564.007213:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8531:x1876607564284544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672564.012781:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8531:x1876607564284544:12345-0@lo:502:llog_process_th.0 Request processed in 5562us (9051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672564.012836:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789672564.013456:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8531:1876607564284544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672564.013517:0:8531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672564.013532:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672564.013535:0:8531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789672564.013544:0:8531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa63fb87000 00000020:00000080:0.0:1789672564.013547:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789672564.013677:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8531:1876607564284672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.013751:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.013819:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672564.025373:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284672 00000100:00100000:2.0:1789672564.025398:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284672 00000100:00100000:2.0:1789672564.025483:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789672564.025497:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8531:x1876607564284672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672564.025876:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:8531:x1876607564284672:12345-0@lo:502:llog_process_th.0 Request processed in 381us (12124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672564.025891:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789672564.026389:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8531:1876607564284672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672564.026437:0:8531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672564.026446:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672564.026449:0:8531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789672564.026456:0:8531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789672564.026537:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789672564.026557:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672564.026569:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.026583:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672564.026595:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672564.026597:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6117c1000 from 4 10000000:01000000:0.0:1789672564.026601:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672564.026638:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.026648:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.026665:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672564.026691:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.026741:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.026778:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.029062:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284800 00000100:00100000:0.0:1789672564.029084:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284800 00000100:00100000:0.0:1789672564.029169:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789672564.029181:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564284800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672564.029216:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672564.029242:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0888d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.029281:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0888d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.029296:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0888d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.029307:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600031200, rc 0) 00000100:00100000:0.0:1789672564.029406:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564284800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.029413:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789672564.029484:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672564.029504:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.029531:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672564.029630:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.029669:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.029691:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.029705:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564284928 00000100:00100000:0.0:1789672564.029709:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564284928 00000100:00100000:0.0:1789672564.029727:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789672564.029733:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564284928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.030076:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564284928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.030083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789672564.030116:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564284928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.030145:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.030187:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.030201:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.030212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285056 00000100:00100000:0.0:1789672564.030216:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285056 00000100:00100000:0.0:1789672564.030235:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789672564.030241:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564285056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.030403:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564285056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.030409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789672564.030452:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.030688:0:8535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8535:1876607564285184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.030724:0:8535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.030741:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285184 00000100:00100000:0.0:1789672564.030745:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285184 00000100:00100000:0.0:1789672564.030763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789672564.030769:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8535:x1876607564285184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.030932:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8535:x1876607564285184:12345-0@lo:502:llog_process_th.0 Request processed in 148us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.030939:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789672564.030965:0:8535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.030977:0:8535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8535:1876607564285184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672564.030999:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672564.031011:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672564.031014:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789672564.031023:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa6117c1000 00000020:00000080:0.0:1789672564.031025:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789672564.031101:0:8535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8535:1876607564285312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.031131:0:8535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.031148:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285312 00000100:00100000:0.0:1789672564.031151:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285312 00000100:00100000:0.0:1789672564.031168:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789672564.031174:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8535:x1876607564285312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.031275:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:8535:x1876607564285312:12345-0@lo:502:llog_process_th.0 Request processed in 101us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.031282:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789672564.031315:0:8535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.031326:0:8535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8535:1876607564285312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672564.031344:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672564.031348:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672564.031349:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789672564.031353:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789672564.031407:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789672564.031421:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672564.031432:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031442:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672564.031453:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672564.031457:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa604b25800 from 4 10000000:01000000:0.0:1789672564.031460:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672564.031486:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031495:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031505:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672564.031517:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.031544:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.031557:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.031570:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285440 00000100:00100000:0.0:1789672564.031579:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285440 00000100:00100000:0.0:1789672564.031597:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789672564.031603:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564285440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672564.031612:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672564.031625:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0889b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031648:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0889b expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031658:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0889b expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031666:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa600030a00, rc 0) 00000100:00100000:0.0:1789672564.031692:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564285440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.031698:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789672564.031725:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672564.031735:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672564.031744:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672564.031807:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.031832:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.031844:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672564.031854:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285568 00000100:00100000:0.0:1789672564.031861:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285568 00000100:00100000:0.0:1789672564.031876:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789672564.031880:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564285568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.045398:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564285568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 13502us (13550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.045416:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789672564.046398:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672564.046479:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f526680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672564.046564:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672564.046614:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa609699540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672564.046640:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285696 00000100:00100000:1.0:1789672564.046649:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285696 00000100:00100000:1.0:1789672564.046702:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789672564.046713:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564285696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672564.049424:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564285696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2701us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672564.049441:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789672564.049538:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f526680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564285696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672564.050402:0:8537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8537:1876607564285824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.050476:0:8537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.050523:0:8537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672564.050585:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285824 00000100:00100000:1.0:1789672564.050595:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285824 00000100:00100000:1.0:1789672564.050676:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789672564.050688:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:8537:x1876607564285824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672564.051011:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:8537:x1876607564285824:12345-0@lo:502:llog_process_th.0 Request processed in 325us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672564.051019:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789672564.060161:0:8537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8537:1876607564285824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672564.060217:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672564.060233:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672564.060235:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789672564.060245:0:8537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa604b25800 00000020:00000080:0.0:1789672564.060248:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789672564.060366:0:8537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8537:1876607564285952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672564.060461:0:8537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.060511:0:8537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608b5cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672564.065286:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564285952 00000100:00100000:1.0:1789672564.065306:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564285952 00000100:00100000:1.0:1789672564.071436:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789672564.071464:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:8537:x1876607564285952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672564.071854:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:8537:x1876607564285952:12345-0@lo:502:llog_process_th.0 Request processed in 403us (11393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672564.071863:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789672564.073371:0:8537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:8537:1876607564285952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672564.073430:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672564.073442:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672564.073445:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789672564.073451:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789672564.074149:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789672564.074177:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672564.074192:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672564.074208:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672564.659211:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564286080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672564.659317:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672564.659453:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286080 00000100:00100000:0.0:1789672564.659466:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286080 00000100:00100000:0.0:1789672564.659577:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789672564.659593:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564286080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672564.659663:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672564.659724:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564286080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672564.659733:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789672564.659780:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23800 x1876607564286080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672564.659832:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564286080:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789672564.660119:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672564.979295:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672566.003295:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672566.708491:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564286592:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.708590:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.708676:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789672566.708683:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564286208:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.708717:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.708743:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564286720:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.708769:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.708822:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564286336:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.708847:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.708865:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564286848:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.708912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.708932:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672566.708937:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564286464:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.708960:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.709003:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286592 00000100:00100000:0.0:1789672566.709012:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286592 00000100:00100000:0.0:1789672566.709083:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286848 00000100:00100000:0.0:1789672566.709097:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286848 00000100:00100000:0.0:1789672566.709129:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672566.709142:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564286592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709207:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564286592:12345-0@lo:400:kworker.0 Request processed in 68us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.709215:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672566.709236:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672566.709243:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564286848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709276:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564286848:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.709283:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672566.709304:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286208 00000100:00100000:0.0:1789672566.709308:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286208 00000100:00100000:0.0:1789672566.709334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789672566.709340:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564286208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709369:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564286208:12345-0@lo:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.709375:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789672566.709405:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286720 00000100:00100000:0.0:1789672566.709409:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286720 00000100:00100000:0.0:1789672566.709436:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286336 00000100:00100000:0.0:1789672566.709439:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286336 00000100:00100000:0.0:1789672566.709450:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286464 00000100:00100000:0.0:1789672566.709452:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286464 00000100:00100000:0.0:1789672566.709467:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672566.709473:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564286720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709505:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564286720:12345-0@lo:400:kworker.0 Request processed in 32us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.709518:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672566.709530:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672566.709536:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564286336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709565:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564286336:12345-0@lo:400:kworker.0 Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.709570:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672566.709580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789672566.709586:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564286464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709609:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564286464:12345-0@lo:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.709614:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789672566.709646:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672566.709652:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672566.709655:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672566.709706:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564286464:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709719:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564286336:0@lo:400:kworker.0 00010000:00080000:0.0:1789672566.709733:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608071500 x1876607564286848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672566.709745:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564286848:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709780:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564286208:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.709819:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564286720:0@lo:400:kworker.0 00010000:00080000:0.0:1789672566.709829:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e22a00 x1876607564286592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672566.709849:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564286592:0@lo:400:kworker.0 00000100:00100000:0.0:1789672566.712857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564286976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672566.712975:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672566.713058:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564286976 00000100:00100000:0.0:1789672566.713068:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564286976 00000100:00100000:0.0:1789672566.714999:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789672566.715015:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564286976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672566.715065:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672566.715163:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564286976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.715169:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789672566.716661:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e56d80 x1876607564286976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672566.716688:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564286976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672566.953464:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672566.953518:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672566.953570:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672566.953598:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672566.953637:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286016 00000100:00100000:0.0:1789672566.953650:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286016 00000100:00100000:3.0:1789672566.953674:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286400 00000100:00100000:3.0:1789672566.953681:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286400 00000100:00100000:0.0:1789672566.953727:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 190 00000100:00100000:0.0:1789672566.953741:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2359:x1876607543286016:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672566.953744:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286272 00000100:00100000:3.0:1789672566.953750:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286272 00000100:00100000:3.0:1789672566.953779:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:3.0:1789672566.953818:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543286400:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672566.953924:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286144 00000100:00100000:1.0:1789672566.953929:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286144 00000100:00100000:1.0:1789672566.953969:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:1.0:1789672566.953976:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543286144:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672566.954037:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2359:x1876607543286016:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.954046:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 190 00000100:00100000:0.0:1789672566.954093:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:0.0:1789672566.954101:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543286272:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672566.955957:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543286400:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 2046us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672566.955973:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00080000:3.0:1789672566.956034:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672566.956042:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672566.956045:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672566.958669:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543286144:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 4676us (5204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672566.958687:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:0.0:1789672566.958820:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543286272:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 4716us (5217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672566.958833:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00010000:00010000:3.0:1789672567.027750:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672568.052912:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672569.075681:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672569.377830:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789672569.779066:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564287104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672569.779137:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672569.779615:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287104 00000100:00100000:0.0:1789672569.779623:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287104 00000100:00100000:0.0:1789672569.779861:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672569.779886:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564287104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672569.779930:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672569.779982:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564287104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672569.779990:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789672569.780298:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608071500 x1876607564287104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672569.780316:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564287104:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789672569.784589:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672570.100337:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672571.129440:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672571.827215:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564287232:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672571.827383:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564287744:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672571.827441:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672571.827447:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564287616:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827467:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672571.827495:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564287360:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672571.827532:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564287872:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827551:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672571.827570:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672571.827575:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564287488:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672571.827626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287744 00000100:00100000:1.0:1789672571.827634:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287744 00000100:00100000:1.0:1789672571.827696:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287360 00000100:00100000:1.0:1789672571.827700:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287360 00000100:00100000:1.0:1789672571.827714:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287488 00000100:00100000:1.0:1789672571.827716:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287488 00000100:00100000:1.0:1789672571.827731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789672571.827739:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564287744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827832:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564287744:12345-0@lo:400:kworker.0 Request processed in 93us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672571.827840:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789672571.827872:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672571.827878:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564287360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827919:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564287360:12345-0@lo:400:kworker.0 Request processed in 41us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672571.827925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672571.827940:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789672571.827946:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564287488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.827970:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564287488:12345-0@lo:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672571.827976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789672571.827993:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287616 00000100:00100000:1.0:1789672571.827997:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287616 00000100:00100000:1.0:1789672571.828023:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287872 00000100:00100000:1.0:1789672571.828026:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287872 00000100:00100000:1.0:1789672571.828043:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672571.828049:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564287616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.828078:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564287616:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672571.828084:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672571.828094:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672571.828100:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564287872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.828125:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564287872:12345-0@lo:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672571.828129:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789672571.828149:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672571.828153:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672571.828155:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672571.828193:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564287488:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.828211:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564287360:0@lo:400:kworker.0 00010000:00080000:1.0:1789672571.828222:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e21c00 x1876607564287872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672571.828231:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564287872:0@lo:400:kworker.0 00010000:00080000:1.0:1789672571.828275:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23800 x1876607564287616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672571.828284:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564287616:0@lo:400:kworker.0 00000100:00100000:1.0:1789672571.828293:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564287744:0@lo:400:kworker.0 00000100:00100000:0.0:1789672571.828781:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564287232 00000100:00100000:0.0:1789672571.828815:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564287232 00000100:00100000:0.0:1789672571.828861:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789672571.828869:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564287232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672571.828918:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564287232:12345-0@lo:400:kworker.0 Request processed in 50us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672571.828925:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789672571.828969:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564287232:0@lo:400:kworker.0 00000100:00100000:0.0:1789672571.831379:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672571.831400:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672571.831463:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672571.831539:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288000 00000100:00100000:2.0:1789672571.831548:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288000 00000100:00100000:2.0:1789672571.831600:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672571.831609:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564288000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672571.831642:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672571.831688:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564288000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672571.831694:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789672571.831706:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23100 x1876607564288000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672571.831733:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672572.073185:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672572.073230:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672572.073263:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672572.073291:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672572.073317:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286656 00000100:00100000:3.0:1789672572.073326:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286656 00000100:00100000:3.0:1789672572.073387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:3.0:1789672572.073397:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543286656:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672572.073471:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543286656:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672572.073478:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:3.0:1789672572.073502:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286784 00000100:00100000:3.0:1789672572.073506:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286784 00000100:00100000:3.0:1789672572.073533:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286912 00000100:00100000:3.0:1789672572.073545:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286912 00000100:00100000:3.0:1789672572.073571:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:3.0:1789672572.073578:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543286784:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672572.073604:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543286784:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672572.073610:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:3.0:1789672572.073622:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:3.0:1789672572.073628:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543286912:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672572.073649:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543286912:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672572.073654:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00080000:3.0:1789672572.075831:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672572.075850:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672572.075855:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672572.076502:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543286528 00000100:00100000:1.0:1789672572.076514:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543286528 00000100:00100000:1.0:1789672572.076577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 192 00000100:00100000:1.0:1789672572.076586:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543286528:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672572.076645:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543286528:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 61us (3469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672572.076651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 192 00010000:00010000:0.0:1789672572.148164:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672573.179415:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672574.190351:0:9042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing yml_node 00010000:00010000:1.0:1789672574.195945:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672574.903337:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672574.903365:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564288128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672574.903438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672574.903538:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288128 00000100:00100000:1.0:1789672574.903548:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288128 00000100:00100000:1.0:1789672574.903618:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789672574.903631:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564288128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672574.903669:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672574.903718:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564288128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672574.903725:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789672574.903829:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672574.903863:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f524a80 x1876607564288128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672574.903883:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564288128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672575.221360:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672576.243606:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672576.947380:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564288512:0@lo:400:kworker.0 00000100:00100000:2.0:1789672576.947472:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672576.947534:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564289024:0@lo:400:kworker.0 00000100:00100000:2.0:1789672576.947560:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672576.947590:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789672576.947596:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564288384:0@lo:400:kworker.0 00000100:00100000:2.0:1789672576.947622:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672576.947649:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564288896:0@lo:400:kworker.0 00000100:00100000:2.0:1789672576.947671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672576.947703:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288512 00000100:00100000:2.0:1789672576.947715:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288512 00000100:00100000:2.0:1789672576.947755:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288896 00000100:00100000:2.0:1789672576.947758:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288896 00000100:00100000:2.0:1789672576.947818:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672576.947828:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564288512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672576.947875:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564288512:12345-0@lo:400:kworker.0 Request processed in 49us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672576.947899:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672576.947917:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789672576.947923:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564288896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672576.947962:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564288896:12345-0@lo:400:kworker.0 Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672576.947968:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672576.948672:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288384 00000100:00100000:0.0:1789672576.948678:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288384 00000100:00100000:0.0:1789672576.948712:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789672576.948720:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564288384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672576.948762:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564288384:12345-0@lo:400:kworker.0 Request processed in 43us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672576.948768:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1789672576.948832:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672576.948865:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564288384:0@lo:400:kworker.0 00000100:00100000:0.0:1789672576.948878:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564288896:0@lo:400:kworker.0 00000100:00100000:0.0:1789672576.948887:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564288512:0@lo:400:kworker.0 00000100:00100000:1.0:1789672576.949088:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564288640:0@lo:400:kworker.0 00000100:00100000:1.0:1789672576.949122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672576.949159:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789672576.949165:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564288256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672576.949189:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672576.949208:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564288768:0@lo:400:kworker.0 00000100:00100000:1.0:1789672576.949229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672576.949262:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288256 00000100:00100000:1.0:1789672576.949265:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288256 00000100:00100000:1.0:1789672576.949317:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672576.949324:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564288256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672576.949351:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672576.949579:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564288256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672576.949588:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672576.949609:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289024 00000100:00100000:1.0:1789672576.949613:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289024 00000100:00100000:1.0:1789672576.949633:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288768 00000100:00100000:1.0:1789672576.949636:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288768 00000100:00100000:1.0:1789672576.949655:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672576.949661:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564289024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672576.949698:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564289024:12345-0@lo:400:kworker.0 Request processed in 37us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672576.949704:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672576.949715:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672576.949721:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564288768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672576.949747:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564288768:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672576.949764:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789672576.949839:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672576.949843:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672576.949865:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e23100 x1876607564288256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672576.949882:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564288256:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789672576.949892:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e55880 x1876607564288768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672576.949900:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564288768:0@lo:400:kworker.0 00000100:00100000:3.0:1789672576.950111:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564288640 00000100:00100000:3.0:1789672576.950116:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564288640 00000100:00100000:3.0:1789672576.950158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672576.950168:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564288640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672576.950212:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564288640:12345-0@lo:400:kworker.0 Request processed in 48us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672576.950218:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672576.950252:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564288640:0@lo:400:kworker.0 00010000:00080000:0.0:1789672576.950560:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e55c00 x1876607564289024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672576.950569:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564289024:0@lo:400:kworker.0 00000100:00080000:1.0:1789672576.950779:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672577.204543:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672577.204589:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672577.204629:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287040 00000100:00100000:2.0:1789672577.204641:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287040 00000100:00100000:2.0:1789672577.204709:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 194 00000100:00100000:2.0:1789672577.204720:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543287040:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672577.204838:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543287040:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672577.204845:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 194 00000100:00100000:0.0:1789672577.205504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287168 00000100:00100000:0.0:1789672577.205511:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287168 00000100:00100000:0.0:1789672577.205570:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:0.0:1789672577.205579:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543287168:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672577.205624:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543287168:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 46us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672577.205648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00080000:2.0:1789672577.205719:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672577.213915:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672577.213963:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672577.214042:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287296 00000100:00100000:1.0:1789672577.214052:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287296 00000100:00100000:0.0:1789672577.214221:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287424 00000100:00100000:0.0:1789672577.214226:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287424 00000100:00100000:0.0:1789672577.214259:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:0.0:1789672577.214272:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2356:x1876607543287296:12345-192.168.202.39@tcp:9:kworker.0 00000020:00000080:0.0:1789672577.214309:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d087de 00000100:00080000:0.0:1789672577.214320:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fa5022a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672577.214358:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789672577.215016:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:1.0:1789672577.215027:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2356:x1876607543287424:12345-192.168.202.39@tcp:9:kworker.0 00000020:00000080:1.0:1789672577.215047:0:8063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d087e5 00000100:00080000:1.0:1789672577.215054:0:8063:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789672577.215082:0:8063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1789672577.215223:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672577.215227:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672577.215257:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672577.215263:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672577.215581:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+2:2356:x1876607543287296:12345-192.168.202.39@tcp:9:kworker.0 Request processed in 1311us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672577.215590:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672577.215779:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+2:2356:x1876607543287424:12345-192.168.202.39@tcp:9:kworker.0 Request processed in 754us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672577.215831:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00010000:00010000:2.0:1789672577.267273:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672578.294714:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789672578.514816:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000020:00000080:1.0:1789672578.514824:0:6710:0:(genops.c:885:class_export_put()) final put ffff9fa5022af800/7225c799-181e-4570-897c-b66842e45960 00000020:00000080:0.0:1789672578.514908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa5022af800/7225c799-181e-4570-897c-b66842e45960 for lustre-OST0000 00000020:00000080:0.0:1789672578.514949:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa5022a9800 for lustre-OST0000 00000001:02000400:0.0:1789672578.917118:0:9236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789672579.315410:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672580.021727:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564289152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672580.021821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672580.023727:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289152 00000100:00100000:1.0:1789672580.023741:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289152 00000100:00100000:1.0:1789672580.023840:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672580.023864:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564289152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672580.023899:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672580.023971:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564289152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672580.023978:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789672580.024114:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672580.024149:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4ea00 x1876607564289152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672580.024182:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564289152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672580.339101:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672581.100559:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000020:00000080:2.0:1789672581.100569:0:7637:0:(genops.c:885:class_export_put()) final put ffff9fa62f3d1800/7225c799-181e-4570-897c-b66842e45960 00000020:00000080:3.0:1789672581.100640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa62f3d1800/7225c799-181e-4570-897c-b66842e45960 for lustre-OST0001 00000020:00000080:3.0:1789672581.106488:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa62f3d4800 for lustre-OST0001 00010000:00010000:3.0:1789672581.363556:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672581.552162:0:9334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:3.0:1789672582.070422:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564289280:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.070492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672582.070535:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564289792:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.070555:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672582.070574:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672582.070578:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564289664:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.070606:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672582.070628:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564289408:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.070643:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672582.070653:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564289920:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.070663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672582.070674:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672582.070676:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564289536:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.070686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672582.070707:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289280 00000100:00100000:3.0:1789672582.070713:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289280 00000100:00100000:3.0:1789672582.070763:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789672582.070773:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564289280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071131:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289792 00000100:00100000:2.0:1789672582.071135:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289792 00000100:00100000:2.0:1789672582.071162:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289408 00000100:00100000:2.0:1789672582.071164:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289408 00000100:00100000:2.0:1789672582.071170:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289536 00000100:00100000:2.0:1789672582.071172:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289536 00000100:00100000:2.0:1789672582.071180:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672582.071184:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071214:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564289792:12345-0@lo:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672582.071219:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672582.071242:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672582.071246:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071265:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564289408:12345-0@lo:400:kworker.0 Request processed in 20us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672582.071269:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672582.071275:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672582.071279:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564289536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071293:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564289536:12345-0@lo:400:kworker.0 Request processed in 14us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672582.071296:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672582.071317:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289664 00000100:00100000:2.0:1789672582.071319:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289664 00000100:00100000:2.0:1789672582.071334:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564289920 00000100:00100000:2.0:1789672582.071336:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564289920 00000100:00100000:2.0:1789672582.071352:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672582.071356:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564289664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071376:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564289664:12345-0@lo:400:kworker.0 Request processed in 20us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672582.071380:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672582.071386:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672582.071389:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071404:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564289920:12345-0@lo:400:kworker.0 Request processed in 15us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672582.071410:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789672582.071427:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672582.071430:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672582.071432:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789672582.071487:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607f18e00 x1876607564289664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672582.071502:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564289664:0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071513:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564289792:0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071547:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564289536:0@lo:400:kworker.0 00000100:00100000:2.0:1789672582.071557:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564289408:0@lo:400:kworker.0 00010000:00080000:2.0:1789672582.071566:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607f1ad80 x1876607564289920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672582.071587:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564289920:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.071741:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564289280:12345-0@lo:400:kworker.0 Request processed in 968us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672582.071757:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789672582.073011:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672582.073058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672582.073105:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290048 00000100:00100000:0.0:1789672582.073112:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290048 00000100:00100000:0.0:1789672582.073151:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672582.073159:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672582.073192:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672582.073247:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672582.073253:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789672582.073289:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa61871f100 x1876607564290048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672582.073318:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672582.075280:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564289280:0@lo:400:kworker.0 00000100:00100000:3.0:1789672582.315732:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672582.315805:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672582.315841:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287552 00000100:00100000:1.0:1789672582.315852:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287552 00000100:00100000:1.0:1789672582.315906:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 196 00000100:00100000:1.0:1789672582.315916:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543287552:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672582.315983:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543287552:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672582.315992:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 196 00000100:00100000:0.0:1789672582.316298:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287680 00000100:00100000:0.0:1789672582.316303:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287680 00000100:00100000:0.0:1789672582.316348:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:0.0:1789672582.316355:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543287680:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672582.316389:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543287680:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672582.316945:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00080000:0.0:1789672582.316968:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672582.387298:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672583.411108:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672584.312371:0:9431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789672584.434977:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672585.141013:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672585.141088:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672585.141332:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290176 00000100:00100000:0.0:1789672585.141340:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290176 00000100:00100000:0.0:1789672585.141422:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789672585.141435:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564290176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672585.141469:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672585.141537:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564290176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672585.141543:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789672585.141654:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4c700 x1876607564290176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672585.141674:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564290176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789672585.141748:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672585.468081:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789672586.071010:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 17 15:16:25 EDT 2026 00010000:00010000:2.0:1789672586.487297:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672587.187374:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564290688:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187446:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672587.187503:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789672587.187510:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564290304:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187539:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672587.187562:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564290816:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187596:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672587.187620:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564290432:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672587.187656:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564290944:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187674:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672587.187687:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672587.187691:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187724:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672587.187758:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290304 00000100:00100000:0.0:1789672587.187765:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290304 00000100:00100000:0.0:1789672587.187834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789672587.187844:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564290304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.187907:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564290304:12345-0@lo:400:kworker.0 Request processed in 66us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672587.187915:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789672587.187948:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290816 00000100:00100000:0.0:1789672587.187952:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290816 00000100:00100000:0.0:1789672587.188003:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290432 00000100:00100000:0.0:1789672587.188007:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290432 00000100:00100000:0.0:1789672587.188022:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290560 00000100:00100000:0.0:1789672587.188024:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290560 00000100:00100000:0.0:1789672587.188040:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789672587.188047:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564290816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.188081:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564290816:12345-0@lo:400:kworker.0 Request processed in 34us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672587.188088:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789672587.188100:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789672587.188113:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564290432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.188162:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564290432:12345-0@lo:400:kworker.0 Request processed in 50us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672587.188169:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789672587.188182:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789672587.188190:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564290560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.188216:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564290560:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672587.188223:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789672587.188266:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.188277:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564290432:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.188304:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564290304:0@lo:400:kworker.0 00000100:00100000:0.0:1789672587.188313:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564290816:0@lo:400:kworker.0 00000100:00100000:2.0:1789672587.188932:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290688 00000100:00100000:2.0:1789672587.188938:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290688 00000100:00100000:2.0:1789672587.188989:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564290944 00000100:00100000:2.0:1789672587.188993:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564290944 00000100:00100000:2.0:1789672587.189021:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789672587.189029:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672587.189076:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564290688:12345-0@lo:400:kworker.0 Request processed in 49us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672587.189083:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789672587.189097:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789672587.189104:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672587.189146:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564290944:12345-0@lo:400:kworker.0 Request processed in 42us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672587.189152:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789672587.189178:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672587.189426:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672587.189429:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672587.189918:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564291072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672587.189961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789672587.190273:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e15f80 x1876607564290944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672587.190289:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564290944:0@lo:400:kworker.0 00010000:00080000:0.0:1789672587.190321:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa608071500 x1876607564290688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672587.190331:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564290688:0@lo:400:kworker.0 00000100:00100000:3.0:1789672587.190864:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291072 00000100:00100000:3.0:1789672587.190873:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291072 00000100:00100000:3.0:1789672587.190928:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789672587.190936:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564291072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672587.190969:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672587.191035:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564291072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672587.191042:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789672587.191146:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4e300 x1876607564291072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672587.191177:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564291072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672587.434895:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672587.434955:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672587.435043:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287936 00000100:00100000:2.0:1789672587.435054:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287936 00000100:00100000:2.0:1789672587.435155:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:2.0:1789672587.435165:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543287936:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672587.435241:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543287936:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672587.435249:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00080000:3.0:1789672587.435372:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672587.435819:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543287808 00000100:00100000:1.0:1789672587.435824:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543287808 00000100:00100000:1.0:1789672587.435853:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 198 00000100:00100000:1.0:1789672587.435861:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2359:x1876607543287808:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672587.435905:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2359:x1876607543287808:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 44us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672587.435912:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 198 00010000:00010000:3.0:1789672587.509259:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672588.532130:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672589.556517:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672590.259768:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564291200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672590.259915:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672590.260123:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291200 00000100:00100000:3.0:1789672590.260137:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291200 00000100:00100000:3.0:1789672590.260317:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672590.260339:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564291200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672590.260385:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672590.260454:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564291200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672590.260463:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789672590.260757:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672590.260871:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4df80 x1876607564291200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672590.260896:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564291200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672590.579261:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672591.603089:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672592.307610:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564291328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672592.307729:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672592.310476:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564291456:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.310575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672592.310687:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564291968:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.310718:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672592.310752:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672592.310759:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564291584:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.310783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672592.310837:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564291712:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.310862:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672592.310881:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672592.310886:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564291840:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.310912:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672592.310945:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291968 00000100:00100000:2.0:1789672592.310956:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291968 00000100:00100000:2.0:1789672592.311024:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291584 00000100:00100000:2.0:1789672592.311028:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291584 00000100:00100000:2.0:1789672592.311043:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291712 00000100:00100000:2.0:1789672592.311046:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291712 00000100:00100000:2.0:1789672592.311067:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672592.311078:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564291968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311140:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564291968:12345-0@lo:400:kworker.0 Request processed in 64us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672592.311161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672592.311182:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789672592.311188:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564291584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311220:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564291584:12345-0@lo:400:kworker.0 Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672592.311226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789672592.311237:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789672592.311243:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564291712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311275:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564291712:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672592.311281:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789672592.311328:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291840 00000100:00100000:2.0:1789672592.311332:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291840 00000100:00100000:2.0:1789672592.311364:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672592.311371:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564291840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311404:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564291840:12345-0@lo:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672592.311410:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789672592.311428:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672592.311433:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789672592.311472:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e54000 x1876607564291840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672592.311489:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564291840:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311501:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564291712:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311535:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564291584:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.311552:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564291968:0@lo:400:kworker.0 00000100:00100000:1.0:1789672592.315021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291456 00000100:00100000:1.0:1789672592.315045:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291456 00000100:00100000:1.0:1789672592.315138:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789672592.315151:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564291456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672592.315283:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564291456:12345-0@lo:400:kworker.0 Request processed in 135us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672592.315301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789672592.315446:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564291456:0@lo:400:kworker.0 00000100:00100000:2.0:1789672592.315863:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564291328 00000100:00100000:2.0:1789672592.315870:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564291328 00000100:00100000:2.0:1789672592.315931:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789672592.315939:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564291328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672592.315983:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672592.316041:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564291328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (8313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672592.316048:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789672592.316205:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672592.316574:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4c380 x1876607564291328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672592.316599:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564291328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672592.553550:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672592.553615:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672592.553700:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288192 00000100:00100000:0.0:1789672592.553715:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288192 00000100:00100000:0.0:1789672592.553827:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:0.0:1789672592.553840:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543288192:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672592.553939:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543288192:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 102us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672592.553948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00080000:0.0:1789672592.553977:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672592.556131:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288064 00000100:00100000:3.0:1789672592.556152:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288064 00000100:00100000:3.0:1789672592.556241:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 200 00000100:00100000:3.0:1789672592.556254:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543288064:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672592.556351:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543288064:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 99us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672592.556359:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 200 00010000:00010000:3.0:1789672592.629007:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672593.651139:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672594.675600:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672595.381016:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564292096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672595.381112:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672595.381345:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292096 00000100:00100000:1.0:1789672595.381678:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292096 00000100:00100000:1.0:1789672595.381759:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789672595.381770:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564292096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672595.381980:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672595.382101:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564292096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 332us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672595.382110:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789672595.382138:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672595.387091:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4e680 x1876607564292096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672595.387127:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564292096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672595.699051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672596.722955:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672597.428818:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564292224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672597.428924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672597.429042:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292224 00000100:00100000:1.0:1789672597.429054:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292224 00000100:00100000:1.0:1789672597.429422:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672597.429436:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564292224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672597.429490:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672597.429554:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564292224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672597.429562:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789672597.429593:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672597.429656:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4f800 x1876607564292224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672597.429680:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564292224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672597.430212:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564292480:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.430265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672597.430298:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672597.430304:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564292608:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.430328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672597.430368:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292480 00000100:00100000:3.0:1789672597.430374:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292480 00000100:00100000:3.0:1789672597.430415:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292608 00000100:00100000:3.0:1789672597.430418:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292608 00000100:00100000:3.0:1789672597.430448:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789672597.430456:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564292480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789672597.430466:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672597.430488:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564292736:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.430527:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564292480:12345-0@lo:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672597.430534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672597.430538:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789672597.430559:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789672597.430568:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564292608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672597.430568:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789672597.430580:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564292352:0@lo:400:kworker.0 00000100:00100000:1.0:1789672597.430624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672597.430655:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564292864:0@lo:400:kworker.0 00000100:00100000:1.0:1789672597.430681:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672597.430708:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292736 00000100:00100000:1.0:1789672597.430712:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292736 00000100:00100000:0.0:1789672597.430730:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292352 00000100:00100000:0.0:1789672597.430744:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292352 00000100:00100000:1.0:1789672597.430758:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672597.430769:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564292736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672597.430829:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789672597.430838:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564292352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672597.431069:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564292352:12345-0@lo:400:kworker.0 Request processed in 232us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672597.431075:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1789672597.431122:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672597.431153:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564292352:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.432184:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564292608:12345-0@lo:400:kworker.0 Request processed in 1612us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672597.432197:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789672597.432229:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292864 00000100:00100000:3.0:1789672597.432237:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292864 00000100:00100000:3.0:1789672597.432290:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789672597.432298:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564292864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.432352:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564292864:12345-0@lo:400:kworker.0 Request processed in 56us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672597.432359:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789672597.432400:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672597.432437:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564292608:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.432452:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564292480:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.432486:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564292864:0@lo:400:kworker.0 00000100:00100000:0.0:1789672597.434462:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564292736:12345-0@lo:400:kworker.0 Request processed in 3683us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672597.434479:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789672597.435120:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa61871c700 x1876607564292736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672597.435140:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564292736:0@lo:400:kworker.0 00000100:00100000:3.0:1789672597.675213:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672597.675276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672597.675336:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288320 00000100:00100000:3.0:1789672597.675350:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288320 00000100:00100000:3.0:1789672597.675421:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 202 00000100:00100000:3.0:1789672597.675434:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2357:x1876607543288320:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672597.675527:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2357:x1876607543288320:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672597.675536:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 202 00000100:00100000:1.0:1789672597.675918:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288448 00000100:00100000:1.0:1789672597.675925:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288448 00000100:00100000:1.0:1789672597.675981:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:1.0:1789672597.675989:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543288448:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672597.676033:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543288448:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 45us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672597.676039:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00080000:3.0:1789672597.676210:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672597.751079:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672598.771020:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672599.799289:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672600.499113:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672600.499139:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564292992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672600.499228:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672600.499395:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564292992 00000100:00100000:1.0:1789672600.499403:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564292992 00000100:00100000:1.0:1789672600.499475:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672600.499485:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564292992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672600.499522:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672600.499583:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564292992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672600.499591:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789672600.499703:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672600.499733:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4ca80 x1876607564292992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672600.499752:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564292992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672600.823555:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672601.843107:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672602.547064:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564293248:0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.547065:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672602.547082:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564293120:0@lo:400:kworker.0 00000100:00100000:0.0:1789672602.547479:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564293632:0@lo:400:kworker.0 00000100:00100000:2.0:1789672602.554341:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564293376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672602.554544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672602.554642:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564293504:0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.554671:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672602.554713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293120 00000100:00100000:1.0:1789672602.554722:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293120 00000100:00100000:1.0:1789672602.554768:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789672602.554777:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564293120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.554845:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564293120:12345-0@lo:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672602.554853:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789672602.554912:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564293120:0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.554957:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293504 00000100:00100000:1.0:1789672602.554961:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293504 00000100:00100000:1.0:1789672602.554998:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789672602.555004:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564293504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.555039:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564293504:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672602.555046:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789672602.555061:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672602.555079:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564293504:0@lo:400:kworker.0 00000100:00100000:3.0:1789672602.558228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672602.558309:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564293760:0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.558331:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293248 00000100:00100000:1.0:1789672602.558341:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293248 00000100:00100000:3.0:1789672602.558359:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672602.558392:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293760 00000100:00100000:1.0:1789672602.558396:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293760 00000100:00100000:3.0:1789672602.558418:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789672602.558430:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564293248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672602.558483:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564293248:12345-0@lo:400:kworker.0 Request processed in 56us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672602.558492:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789672602.558504:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789672602.558536:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564293760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.558594:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564293760:12345-0@lo:400:kworker.0 Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672602.558600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672602.558641:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293632 00000100:00100000:0.0:1789672602.558645:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293632 00000100:00100000:0.0:1789672602.558690:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672602.558699:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564293632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672602.558737:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564293632:12345-0@lo:400:kworker.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672602.558764:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789672602.558831:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e55c00 x1876607564293632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672602.558846:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564293632:0@lo:400:kworker.0 00000100:00080000:0.0:1789672602.558893:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672602.558898:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672602.560541:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564293760:0@lo:400:kworker.0 00000100:00100000:3.0:1789672602.560568:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61871dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564293248:0@lo:400:kworker.0 00000100:00100000:2.0:1789672602.562658:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672602.562717:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564293888:0@lo:400:kworker.0 00000100:00100000:0.0:1789672602.562732:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293376 00000100:00100000:0.0:1789672602.562741:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293376 00000100:00100000:2.0:1789672602.562757:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672602.562828:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564293888 00000100:00100000:2.0:1789672602.562833:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564293888 00000100:00100000:0.0:1789672602.562843:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672602.562854:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564293376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672602.562857:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789672602.562862:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564293888:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789672602.562901:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672602.562913:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564293888:12345-0@lo:400:kworker.0 Request processed in 51us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672602.562932:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564293376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672602.562936:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672602.562937:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789672602.562958:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789672602.562969:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607f1bb80 x1876607564293376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672602.562988:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564293376:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789672602.562998:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e54a80 x1876607564293888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672602.563007:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564293888:0@lo:400:kworker.0 00000100:00100000:1.0:1789672602.568027:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789672602.802343:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672602.802389:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672602.802432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288576 00000100:00100000:0.0:1789672602.802442:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288576 00000100:00100000:0.0:1789672602.802493:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 204 00000100:00100000:0.0:1789672602.802504:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2358:x1876607543288576:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672602.804210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288704 00000100:00100000:2.0:1789672602.804226:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288704 00000100:00100000:2.0:1789672602.804321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:2.0:1789672602.804331:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543288704:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672602.804467:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2358:x1876607543288576:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 1963us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672602.804478:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 204 00000100:00080000:0.0:1789672602.804535:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672602.806568:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543288704:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 2214us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672602.806582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 59 00010000:00010000:3.0:1789672602.867258:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672603.317677:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:16:42 (1789672602) === 00010000:00010000:3.0:1789672603.891395:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672603.892838:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672603.893072:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288832 00000100:00100000:1.0:1789672603.893083:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288832 00000100:00100000:1.0:1789672603.893149:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 205 00000100:00100000:1.0:1789672603.893159:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:8122:x1876607543288832:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789672603.893177:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672603.893195:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f2200/0x2247cb9491d088a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf728 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672603.893224:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f2200/0x2247cb9491d088a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf728 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672603.893235:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f2200/0x2247cb9491d088a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf728 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672603.893243:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f2200, rc 0) 00000100:00100000:1.0:1789672603.893313:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8122:x1876607543288832:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 155us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672603.893320:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 205 00000100:00100000:0.0:1789672603.894926:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672603.895022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543288960 00000100:00100000:1.0:1789672603.895031:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543288960 00000100:00100000:1.0:1789672603.895085:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 206 00000100:00100000:1.0:1789672603.895095:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8122:x1876607543288960:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789672603.895433:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8122:x1876607543288960:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 338us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672603.895449:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 206 00000100:00100000:3.0:1789672603.900293:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672603.900444:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289088 00000100:00100000:0.0:1789672603.900453:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289088 00000100:00100000:0.0:1789672603.900513:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 207 00000100:00100000:0.0:1789672603.900524:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8122:x1876607543289088:12345-192.168.202.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789672603.900931:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8122:x1876607543289088:12345-192.168.202.39@tcp:503:mount.lustre.0 Request processed in 408us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672603.900939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 207 00000100:00100000:0.0:1789672603.909396:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672603.909484:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289216 00000100:00100000:3.0:1789672603.909494:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289216 00000100:00100000:3.0:1789672603.909577:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 208 00000100:00100000:3.0:1789672603.909588:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8127:x1876607543289216:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672603.909921:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8127:x1876607543289216:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 334us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672603.909929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 208 00000100:00100000:3.0:1789672603.932656:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672603.932775:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289344 00000100:00100000:1.0:1789672603.932808:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289344 00000100:00100000:1.0:1789672603.932864:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 209 00000100:00100000:1.0:1789672603.932875:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8127:x1876607543289344:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672603.933172:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8127:x1876607543289344:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 298us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672603.933180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 209 00000100:00100000:1.0:1789672603.946204:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672603.946303:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289472 00000100:00100000:0.0:1789672603.946314:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289472 00000100:00100000:0.0:1789672603.946372:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 210 00000100:00100000:0.0:1789672603.946382:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:8122:x1876607543289472:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789672603.946399:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672603.946416:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa642045400/0x2247cb9491d088b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf752 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672603.946446:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa642045400/0x2247cb9491d088b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf752 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672603.946458:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa642045400/0x2247cb9491d088b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf752 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672603.946467:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642045400, rc 0) 00000100:00100000:0.0:1789672603.946527:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:8122:x1876607543289472:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672603.946534:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 210 00000100:00100000:0.0:1789672603.950051:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672603.950135:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289600 00000100:00100000:3.0:1789672603.950144:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289600 00000100:00100000:3.0:1789672603.950200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 211 00000100:00100000:3.0:1789672603.950209:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:8122:x1876607543289600:12345-192.168.202.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789672603.950234:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789672603.950257:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789672603.950261:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789672603.950265:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789672603.950267:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789672603.951383:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:8122:x1876607543289600:12345-192.168.202.39@tcp:256:mount.lustre.0 Request processed in 1170us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672603.951394:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 211 00000100:00100000:1.0:1789672603.955899:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672603.956010:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289728 00000100:00100000:0.0:1789672603.956032:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289728 00000100:00100000:0.0:1789672603.956096:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 212 00000100:00100000:0.0:1789672603.956107:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:8122:x1876607543289728:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789672603.956124:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672603.956143:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf759 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672603.956174:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672603.956187:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672603.956196:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044e00, rc 0) 00000100:00100000:0.0:1789672603.956262:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8122:x1876607543289728:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 156us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672603.956270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 212 00000100:00100000:0.0:1789672603.963713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672603.966004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289856 00000100:00100000:1.0:1789672603.966094:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289856 00000100:00100000:1.0:1789672603.966231:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 213 00000100:00100000:1.0:1789672603.966242:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8122:x1876607543289856:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789672603.967808:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8122:x1876607543289856:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 1558us (4094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672603.967821:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 213 00000100:00100000:3.0:1789672603.970907:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672603.991697:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543289984 00000100:00100000:0.0:1789672603.991714:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543289984 00000100:00100000:0.0:1789672603.991869:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 214 00000100:00100000:0.0:1789672603.991880:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8122:x1876607543289984:12345-192.168.202.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789672603.992487:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8122:x1876607543289984:12345-192.168.202.39@tcp:503:mount.lustre.0 Request processed in 607us (21588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672603.992496:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 214 00000100:00100000:3.0:1789672604.009905:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672604.010144:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290112 00000100:00100000:0.0:1789672604.010154:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290112 00000100:00100000:0.0:1789672604.010211:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 215 00000100:00100000:0.0:1789672604.010222:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8129:x1876607543290112:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789672604.010461:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8129:x1876607543290112:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 240us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672604.010469:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 215 00000100:00100000:3.0:1789672604.019235:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672604.019346:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290240 00000100:00100000:2.0:1789672604.019358:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290240 00000100:00100000:2.0:1789672604.019470:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 216 00000100:00100000:2.0:1789672604.019481:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8129:x1876607543290240:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672604.019770:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:8129:x1876607543290240:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 290us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672604.019778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 216 00000100:00100000:3.0:1789672604.026331:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672604.026683:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290368 00000100:00100000:0.0:1789672604.026696:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290368 00000100:00100000:0.0:1789672604.026769:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:0.0:1789672604.026778:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1876607543290368:12345-192.168.202.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789672604.027001:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1@192.168.202.39@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:0.0:1789672604.027044:0:5831:0:(genops.c:1384:class_connect()) connect: client c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1, cookie 0x2247cb9491d088be 00000004:00100000:0.0:1789672604.027083:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789672604.027367:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9fa5022af800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672604.027448:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:2356:x1876607543290368:12345-192.168.202.39@tcp:38:mount.lustre.0 Request processed in 669us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672604.027456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:3.0:1789672604.029455:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672604.029621:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290752 00000100:00100000:2.0:1789672604.029631:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290752 00000100:00100000:2.0:1789672604.029709:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00080000:0.0:1789672604.029844:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672604.029917:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543290752:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672604.029996:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543290752:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 83us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672604.036752:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:3.0:1789672604.047084:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672604.047243:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290624 00000100:00100000:1.0:1789672604.047260:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290624 00000100:00100000:1.0:1789672604.047362:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:1.0:1789672604.047373:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:8122:x1876607543290624:12345-192.168.202.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789672604.047445:0:7918:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789672604.047565:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:8122:x1876607543290624:12345-192.168.202.39@tcp:41:mount.lustre.0 Request processed in 193us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672604.047572:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00080000:0.0:1789672604.047710:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672604.056698:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672604.057006:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672604.059994:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290496 00000100:00100000:3.0:1789672604.060011:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290496 00000100:00100000:3.0:1789672604.060120:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543290880 00000100:00100000:3.0:1789672604.060125:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543290880 00000100:00100000:2.0:1789672604.060405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:2.0:1789672604.060421:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+7:0:x1876607543290496:12345-192.168.202.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789672604.060463:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789672604.060909:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:1.0:1789672604.060922:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+7:8122:x1876607543290880:12345-192.168.202.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789672604.061059:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+7:8122:x1876607543290880:12345-192.168.202.39@tcp:40:mount.lustre.0 Request processed in 141us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672604.061066:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:2.0:1789672604.061222:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:0:x1876607543290496:12345-192.168.202.39@tcp:41:mount.lustre.0 Request processed in 806us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672604.061230:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:2.0:1789672604.065781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672604.065903:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291008 00000100:00100000:0.0:1789672604.065914:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291008 00000100:00100000:0.0:1789672604.065965:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:0.0:1789672604.065975:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1876607543291008:12345-192.168.202.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789672604.066009:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1@192.168.202.39@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:0.0:1789672604.066041:0:6684:0:(genops.c:1384:class_connect()) connect: client c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1, cookie 0x2247cb9491d088c5 00002000:00100000:0.0:1789672604.066064:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1/ffff9fa5022ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789672604.066087:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789672604.066333:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789672604.066363:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fa5022ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672604.066440:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:2356:x1876607543291008:12345-192.168.202.39@tcp:8:mount.lustre.0 Request processed in 465us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672604.066448:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:0.0:1789672604.072273:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672604.072332:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672604.072439:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291136 00000100:00100000:2.0:1789672604.072451:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291136 00000100:00100000:2.0:1789672604.072500:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:2.0:1789672604.072508:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1876607543291136:12345-192.168.202.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789672604.072556:0:8063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1@192.168.202.39@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1789672604.072588:0:8063:0:(genops.c:1384:class_connect()) connect: client c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1, cookie 0x2247cb9491d088cc 00002000:00100000:2.0:1789672604.072600:0:8063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1/ffff9fa62f544800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789672604.072611:0:8063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789672604.072884:0:8063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789672604.072914:0:8063:0:(import.c:65:import_set_state_nolock()) ffff9fa62f541800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672604.072975:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:2356:x1876607543291136:12345-192.168.202.39@tcp:8:mount.lustre.0 Request processed in 466us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672604.072983:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:1.0:1789672604.074109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291264 00000100:00100000:1.0:1789672604.074120:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291264 00000100:00100000:1.0:1789672604.074171:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:1.0:1789672604.074180:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:8122:x1876607543291264:12345-192.168.202.39@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789672604.074249:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789672604.074400:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:8122:x1876607543291264:12345-192.168.202.39@tcp:33:mount.lustre.0 Request processed in 220us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672604.074408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00000001:00100000:1.0:1789672604.191812:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00010000:00010000:2.0:1789672604.918691:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672605.619330:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672605.619363:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564294016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672605.619458:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672605.619558:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294016 00000100:00100000:0.0:1789672605.619568:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294016 00000100:00100000:0.0:1789672605.619660:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789672605.619671:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672605.619672:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564294016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672605.619727:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672605.619814:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564294016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672605.619835:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789672605.619886:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570fb80 x1876607564294016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672605.619909:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564294016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789672605.940712:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789672606.738427:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000001:00100000:2.0:1789672606.757104:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00010000:00010000:2.0:1789672606.968043:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672607.668246:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564294144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672607.668343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672607.669249:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294144 00000100:00100000:1.0:1789672607.669259:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294144 00000100:00100000:1.0:1789672607.669331:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789672607.669352:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564294144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672607.669669:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564294400:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.669754:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672607.669820:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789672607.669827:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564294272:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.669861:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672607.669889:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564294784:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.669910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789672607.669953:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672607.669965:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564294528:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.669990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672607.670009:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672607.670014:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564294656:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670039:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672607.670069:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294400 00000100:00100000:0.0:1789672607.670074:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294400 00000100:00100000:0.0:1789672607.670110:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294784 00000100:00100000:0.0:1789672607.670113:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294784 00000100:00100000:0.0:1789672607.670131:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294528 00000100:00100000:0.0:1789672607.670133:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294528 00000100:00100000:0.0:1789672607.670147:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789672607.670168:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564294400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670217:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564294400:12345-0@lo:400:kworker.0 Request processed in 63us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672607.670225:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789672607.670245:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672607.670251:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564294784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670276:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564294784:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672607.670282:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672607.670301:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789672607.670307:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564294528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670338:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564294528:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672607.670344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789672607.670361:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294656 00000100:00100000:0.0:1789672607.670364:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294656 00000100:00100000:0.0:1789672607.670407:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789672607.670414:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564294656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670445:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564294656:12345-0@lo:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672607.670451:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789672607.670468:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672607.670471:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789672607.670546:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4ed80 x1876607564294656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672607.670576:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564294656:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670608:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564294528:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670677:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564294784:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670713:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564294400:0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670764:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294272 00000100:00100000:0.0:1789672607.670767:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294272 00000100:00100000:0.0:1789672607.670824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789672607.670831:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564294272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672607.670868:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564294272:12345-0@lo:400:kworker.0 Request processed in 38us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672607.670881:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789672607.670921:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564294272:0@lo:400:kworker.0 00002000:00000024:1.0:1789672607.671254:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672607.671318:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564294144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1968us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672607.671325:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789672607.672134:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa624e54380 x1876607564294144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672607.672610:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564294144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789672607.987150:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672609.012252:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672609.453830:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672609.453873:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672609.453899:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672609.453920:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672609.454088:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672609.454131:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291648 00000100:00100000:3.0:1789672609.454146:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291648 00000100:00100000:3.0:1789672609.454229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291520 00000100:00100000:3.0:1789672609.454233:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291520 00000100:00100000:3.0:1789672609.454264:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:3.0:1789672609.454275:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543291648:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672609.454395:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543291648:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 121us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672609.454403:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:3.0:1789672609.454424:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:3.0:1789672609.454431:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543291520:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672609.454459:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543291520:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672609.454465:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:3.0:1789672609.454497:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291904 00000100:00100000:3.0:1789672609.454501:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291904 00000100:00100000:3.0:1789672609.454531:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291776 00000100:00100000:3.0:1789672609.454535:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291776 00000100:00100000:3.0:1789672609.454561:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:3.0:1789672609.454567:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543291904:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672609.454595:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543291904:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672609.454613:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:3.0:1789672609.454624:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:3.0:1789672609.454630:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543291776:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672609.454654:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543291776:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672609.454661:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00080000:3.0:1789672609.454688:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672609.454693:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672609.454696:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672609.456258:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543291392 00000100:00100000:2.0:1789672609.456278:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543291392 00000100:00100000:2.0:1789672609.456344:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 218 00000100:00100000:2.0:1789672609.456354:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543291392:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672609.456437:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543291392:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 84us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672609.456445:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 218 00000001:02000400:0.0:1789672609.827238:0:10310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789672610.044214:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672610.739096:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672610.744168:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564294912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672610.744262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672610.744405:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564294912 00000100:00100000:0.0:1789672610.744416:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564294912 00000100:00100000:0.0:1789672610.744508:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672610.744519:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564294912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672610.744567:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672610.744621:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564294912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672610.744628:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789672610.744672:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570e300 x1876607564294912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672610.744692:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564294912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789672610.745522:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672611.059052:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672612.094914:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672612.789233:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672612.789260:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564295040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672612.789347:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672612.789756:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295040 00000100:00100000:0.0:1789672612.789765:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295040 00000100:00100000:0.0:1789672612.789851:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789672612.789863:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564295040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672612.789899:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672612.789960:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564295040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672612.789984:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789672612.790123:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672612.790492:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672612.790505:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564295168:0@lo:400:kworker.0 00000100:00100000:3.0:1789672612.790545:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564295680:0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.790545:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672612.790573:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672612.790579:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564295552:0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.790605:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789672612.790607:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570e300 x1876607564295040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672612.790626:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564295040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672612.790633:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295168 00000100:00100000:1.0:1789672612.790636:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295168 00000100:00100000:3.0:1789672612.790649:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295680 00000100:00100000:3.0:1789672612.790653:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295680 00000100:00100000:1.0:1789672612.790677:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789672612.790684:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564295168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672612.790695:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672612.790702:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564295680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.790731:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564295168:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672612.790738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789672612.790741:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564295680:12345-0@lo:400:kworker.0 Request processed in 41us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672612.790746:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789672612.790764:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295552 00000100:00100000:1.0:1789672612.790767:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295552 00000100:00100000:3.0:1789672612.790772:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564295680:0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.790815:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672612.790823:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564295552:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789672612.790829:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672612.790833:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672612.790853:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564295552:12345-0@lo:400:kworker.0 Request processed in 32us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672612.790859:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789672612.790892:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63f8b1500 x1876607564295552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672612.790902:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564295552:0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.790911:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564295168:0@lo:400:kworker.0 00000100:00100000:2.0:1789672612.791167:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564295424:0@lo:400:kworker.0 00000100:00100000:2.0:1789672612.791200:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672612.791232:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672612.791238:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564295296:0@lo:400:kworker.0 00000100:00100000:2.0:1789672612.791261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672612.791390:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295424 00000100:00100000:1.0:1789672612.791394:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295424 00000100:00100000:1.0:1789672612.791439:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295296 00000100:00100000:1.0:1789672612.791443:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295296 00000100:00100000:1.0:1789672612.791473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789672612.791480:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564295424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.791519:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564295424:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672612.791525:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789672612.791537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789672612.791543:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564295296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.791569:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564295296:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672612.791574:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789672612.791602:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564295296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672612.791611:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564295424:0@lo:400:kworker.0 00000100:00080000:2.0:1789672612.791839:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672613.107023:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672614.131763:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672614.575962:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672614.576106:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292032 00000100:00100000:3.0:1789672614.576118:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292032 00000100:00100000:3.0:1789672614.576173:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 220 00000100:00100000:3.0:1789672614.576185:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543292032:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672614.576262:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543292032:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672614.576270:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 220 00000100:00100000:3.0:1789672614.578073:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672614.578152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292160 00000100:00100000:2.0:1789672614.578164:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292160 00000100:00100000:2.0:1789672614.578236:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:2.0:1789672614.578255:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543292160:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672614.578327:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543292160:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672614.578335:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00080000:3.0:1789672614.578485:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672614.580026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672614.580071:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672614.580099:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672614.580127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292288 00000100:00100000:3.0:1789672614.580136:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292288 00000100:00100000:3.0:1789672614.580196:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:3.0:1789672614.580206:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292288:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672614.580274:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292288:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672614.580281:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:3.0:1789672614.580304:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292416 00000100:00100000:3.0:1789672614.580314:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292416 00000100:00100000:3.0:1789672614.580342:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292544 00000100:00100000:3.0:1789672614.580344:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292544 00000100:00100000:3.0:1789672614.580371:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:3.0:1789672614.580378:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292416:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672614.580405:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292416:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672614.580411:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:3.0:1789672614.580422:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:3.0:1789672614.580428:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292544:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672614.580463:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292544:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672614.580470:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00080000:3.0:1789672614.580496:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672614.580500:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672614.580503:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672615.155085:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672615.860899:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672615.860932:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564295808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672615.861016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672615.861094:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295808 00000100:00100000:0.0:1789672615.861102:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295808 00000100:00100000:0.0:1789672615.861159:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789672615.861167:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564295808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672615.861196:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672615.861237:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564295808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672615.861243:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789672615.861258:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4ce00 x1876607564295808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672615.861275:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564295808:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789672615.861678:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789672616.179564:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672617.205329:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672617.907094:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564296320:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672617.907295:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789672617.907302:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564295936:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672617.907368:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564296448:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907395:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672617.907434:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564296192:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907458:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672617.907486:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789672617.907492:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564296064:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672617.907534:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564296576:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672617.907617:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296320 00000100:00100000:3.0:1789672617.907627:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296320 00000100:00100000:3.0:1789672617.907693:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296576 00000100:00100000:3.0:1789672617.907696:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296576 00000100:00100000:3.0:1789672617.907723:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672617.907734:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564296320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907835:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564296320:12345-0@lo:400:kworker.0 Request processed in 103us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672617.907843:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672617.907861:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789672617.907868:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564296576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907901:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564296576:12345-0@lo:400:kworker.0 Request processed in 34us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672617.907907:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789672617.907929:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564295936 00000100:00100000:3.0:1789672617.907933:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564295936 00000100:00100000:3.0:1789672617.907958:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789672617.907964:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564295936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.907992:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564295936:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672617.907998:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789672617.908028:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296448 00000100:00100000:3.0:1789672617.908038:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296448 00000100:00100000:3.0:1789672617.908067:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296192 00000100:00100000:3.0:1789672617.908070:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296192 00000100:00100000:3.0:1789672617.908082:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296064 00000100:00100000:3.0:1789672617.908084:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296064 00000100:00100000:3.0:1789672617.908097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789672617.908102:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564296448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.908133:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564296448:12345-0@lo:400:kworker.0 Request processed in 31us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672617.908138:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789672617.908151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789672617.908158:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.908186:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564296192:12345-0@lo:400:kworker.0 Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672617.908191:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789672617.908201:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789672617.908206:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564296064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.908231:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564296064:12345-0@lo:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672617.908237:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789672617.908310:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564296064:0@lo:400:kworker.0 00010000:00080000:3.0:1789672617.908326:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63f8b0380 x1876607564296576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672617.908338:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564296576:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.908347:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564296192:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.908402:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564295936:0@lo:400:kworker.0 00000100:00100000:3.0:1789672617.908428:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564296448:0@lo:400:kworker.0 00010000:00080000:3.0:1789672617.908441:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63f8b2300 x1876607564296320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672617.908449:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564296320:0@lo:400:kworker.0 00000100:00080000:1.0:1789672617.908693:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672617.908707:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672617.908709:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672617.908904:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672617.908916:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564296704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672617.908962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672617.909250:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296704 00000100:00100000:0.0:1789672617.909257:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296704 00000100:00100000:0.0:1789672617.909305:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789672617.909313:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564296704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672617.909351:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672617.909403:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564296704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672617.909422:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789672617.909745:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570df80 x1876607564296704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672617.909766:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564296704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789672618.229525:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672619.251117:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672619.690272:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672619.690318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672619.690342:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672619.690359:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672619.690411:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672619.690444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292928 00000100:00100000:0.0:1789672619.690457:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292928 00000100:00100000:0.0:1789672619.690528:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292800 00000100:00100000:0.0:1789672619.690531:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292800 00000100:00100000:0.0:1789672619.690577:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 74 00000100:00100000:0.0:1789672619.690589:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292928:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672619.690687:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543292928:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 101us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672619.690695:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 74 00000100:00100000:0.0:1789672619.690716:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:0.0:1789672619.690722:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543292800:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672619.690746:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543292800:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672619.690751:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:0.0:1789672619.690771:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293184 00000100:00100000:0.0:1789672619.690774:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293184 00000100:00100000:0.0:1789672619.690830:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293056 00000100:00100000:0.0:1789672619.690834:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293056 00000100:00100000:0.0:1789672619.690854:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:0.0:1789672619.690861:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543293184:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672619.690889:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543293184:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672619.690895:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:0.0:1789672619.690906:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:0.0:1789672619.690913:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543293056:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672619.690937:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543293056:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672619.690943:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00080000:0.0:1789672619.690960:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672619.690970:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672619.690972:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672619.691340:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543292672 00000100:00100000:3.0:1789672619.691346:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543292672 00000100:00100000:3.0:1789672619.691386:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 222 00000100:00100000:3.0:1789672619.691404:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543292672:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672619.691443:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543292672:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 50us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672619.691449:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 222 00010000:00010000:0.0:1789672620.276002:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672620.979172:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672620.979197:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564296832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672620.979318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672620.979534:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296832 00000100:00100000:0.0:1789672620.979544:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296832 00000100:00100000:0.0:1789672620.979616:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672620.979626:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564296832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672620.979662:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672620.979725:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564296832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672620.979733:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789672620.979937:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672620.980014:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4ed80 x1876607564296832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672620.980035:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564296832:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672621.299049:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672622.323946:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672623.027324:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564297344:0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.027432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672623.027517:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789672623.027534:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564296960:0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.027573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672623.027598:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564297472:0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.027622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672623.027653:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564296960 00000100:00100000:3.0:1789672623.027662:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564296960 00000100:00100000:3.0:1789672623.027705:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789672623.027728:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564296960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.027778:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564296960:12345-0@lo:400:kworker.0 Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672623.027811:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789672623.028181:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564296960:0@lo:400:kworker.0 00000100:00100000:2.0:1789672623.028528:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297344 00000100:00100000:2.0:1789672623.028534:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297344 00000100:00100000:2.0:1789672623.028627:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672623.028636:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564297344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672623.028691:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564297344:12345-0@lo:400:kworker.0 Request processed in 58us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672623.028698:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789672623.029293:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672623.029345:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bd8380 x1876607564297344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672623.029369:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564297344:0@lo:400:kworker.0 00000100:00100000:1.0:1789672623.029528:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564297088:0@lo:400:kworker.0 00000100:00100000:1.0:1789672623.029590:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672623.029629:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564297600:0@lo:400:kworker.0 00000100:00100000:1.0:1789672623.029654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672623.029680:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672623.029687:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564297216:0@lo:400:kworker.0 00000100:00100000:1.0:1789672623.029709:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672623.029741:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297600 00000100:00100000:1.0:1789672623.029747:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297600 00000100:00100000:1.0:1789672623.029813:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789672623.029821:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564297600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672623.029864:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564297600:12345-0@lo:400:kworker.0 Request processed in 44us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672623.029869:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789672623.029891:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672623.029907:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bdb800 x1876607564297600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672623.029916:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564297600:0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.030219:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297472 00000100:00100000:3.0:1789672623.030225:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297472 00000100:00100000:3.0:1789672623.030265:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297088 00000100:00100000:3.0:1789672623.030269:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297088 00000100:00100000:3.0:1789672623.030281:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297216 00000100:00100000:3.0:1789672623.030283:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297216 00000100:00100000:3.0:1789672623.030297:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789672623.030303:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564297472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.030348:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564297472:12345-0@lo:400:kworker.0 Request processed in 45us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672623.030354:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789672623.030377:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789672623.030383:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564297088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.030415:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564297088:12345-0@lo:400:kworker.0 Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672623.030420:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789672623.030431:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789672623.030444:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564297216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.030472:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564297216:12345-0@lo:400:kworker.0 Request processed in 29us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672623.030478:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789672623.030510:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564297472:0@lo:400:kworker.0 00000100:00080000:1.0:1789672623.030992:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672623.031015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564297216:0@lo:400:kworker.0 00000100:00100000:1.0:1789672623.031025:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564297088:0@lo:400:kworker.0 00000100:00100000:3.0:1789672623.031318:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672623.031329:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564297728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672623.031376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672623.031512:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297728 00000100:00100000:0.0:1789672623.031528:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297728 00000100:00100000:0.0:1789672623.031577:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672623.031584:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564297728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672623.031611:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672623.031662:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564297728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672623.031668:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789672623.031946:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bd9180 x1876607564297728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672623.031962:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564297728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789672623.346867:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672624.374782:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672624.813308:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672624.813655:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672624.813877:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672624.813914:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293696 00000100:00100000:3.0:1789672624.813925:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293696 00000100:00100000:3.0:1789672624.814032:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293824 00000100:00100000:3.0:1789672624.814036:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293824 00000100:00100000:3.0:1789672624.814061:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:3.0:1789672624.814071:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61db57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2356:x1876607543293696:12345-192.168.202.39@tcp:9:kworker.0 00000020:00000080:3.0:1789672624.814099:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d088c5 00000100:00080000:3.0:1789672624.814108:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9fa5022ad800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672624.814159:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1789672624.814170:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672624.814230:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:2.0:1789672624.814253:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2356:x1876607543293824:12345-192.168.202.39@tcp:9:kworker.0 00000020:00000080:2.0:1789672624.814299:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d088cc 00000100:00080000:2.0:1789672624.814313:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fa62f541800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789672624.814386:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789672624.814743:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61db57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+2:2356:x1876607543293696:12345-192.168.202.39@tcp:9:kworker.0 Request processed in 669us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672624.814754:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00080000:3.0:1789672624.815026:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672624.815030:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672624.816187:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+2:2356:x1876607543293824:12345-192.168.202.39@tcp:9:kworker.0 Request processed in 1934us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672624.816204:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:2.0:1789672624.816264:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293440 00000100:00100000:2.0:1789672624.816273:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293440 00000100:00080000:3.0:1789672624.816575:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672624.820629:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:2.0:1789672624.820651:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543293440:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672624.820749:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543293440:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 106us (7102us total) trans 0 rc 0/0 00010000:00010000:1.0:1789672624.825154:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672624.825757:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672624.825876:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672624.825906:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293568 00000100:00100000:0.0:1789672624.825917:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293568 00000100:00100000:0.0:1789672624.825976:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:0.0:1789672624.825986:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543293568:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672624.826092:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543293568:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672624.826101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00080000:3.0:1789672624.826336:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672624.826538:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293312 00000100:00100000:1.0:1789672624.826552:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293312 00000100:00100000:1.0:1789672624.826626:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 224 00000100:00100000:1.0:1789672624.826637:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543293312:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672624.826896:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543293312:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 260us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672624.826905:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 224 00000100:00100000:2.0:1789672624.828630:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 79 00010000:00010000:0.0:1789672625.395126:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672626.099120:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564297856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672626.099197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672626.099364:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297856 00000100:00100000:1.0:1789672626.099373:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297856 00000100:00100000:1.0:1789672626.099474:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789672626.099483:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564297856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672626.099533:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672626.099587:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564297856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672626.099594:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789672626.099635:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4df80 x1876607564297856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672626.099654:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564297856:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789672626.099769:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789672626.262772:0:11010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789672626.427730:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789672627.156690:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000020:00000080:3.0:1789672627.156700:0:7637:0:(genops.c:885:class_export_put()) final put ffff9fa62f544800/c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000020:00000080:3.0:1789672627.156735:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa62f544800/c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 for lustre-OST0001 00000020:00000080:3.0:1789672627.156776:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa62f541800 for lustre-OST0001 00010000:00010000:2.0:1789672627.443658:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672628.147204:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564297984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672628.147275:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672628.147401:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564297984 00000100:00100000:2.0:1789672628.147419:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564297984 00000100:00100000:0.0:1789672628.147442:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564298240:0@lo:400:kworker.0 00000100:00100000:2.0:1789672628.147473:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789672628.147483:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564297984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672628.147514:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789672628.147528:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672628.147537:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789672628.147542:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564298112:0@lo:400:kworker.0 00000100:00100000:0.0:1789672628.147566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672628.147569:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564297984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672628.147576:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789672628.147586:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564298624:0@lo:400:kworker.0 00000100:00080000:2.0:1789672628.147597:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672628.147604:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672628.147627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564298112 00000100:00100000:0.0:1789672628.147631:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564298112 00000100:00100000:2.0:1789672628.147635:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564298240 00000100:00100000:2.0:1789672628.147638:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564298240 00000100:00100000:2.0:1789672628.147658:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564298624 00000100:00100000:0.0:1789672628.147660:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789672628.147666:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564298112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672628.147667:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564298624 00000100:00100000:2.0:1789672628.147692:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789672628.147698:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564298240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672628.147698:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564298112:12345-0@lo:400:kworker.0 Request processed in 32us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672628.147704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789672628.147730:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789672628.147737:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672628.147739:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564298240:12345-0@lo:400:kworker.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672628.147744:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1789672628.147762:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672628.147762:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564298624:12345-0@lo:400:kworker.0 Request processed in 26us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672628.147768:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789672628.147808:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564298368:0@lo:400:kworker.0 00000100:00100000:0.0:1789672628.147850:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672628.147884:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672628.147891:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564298496:0@lo:400:kworker.0 00000100:00100000:0.0:1789672628.147913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789672628.147962:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bd9880 x1876607564297984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672628.147980:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564297984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672628.147990:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564298496 00000100:00100000:1.0:1789672628.147994:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564298496 00000100:00100000:0.0:1789672628.148007:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564298112:0@lo:400:kworker.0 00000100:00100000:0.0:1789672628.148016:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564298624:0@lo:400:kworker.0 00000100:00100000:0.0:1789672628.148024:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564298240:0@lo:400:kworker.0 00000100:00100000:1.0:1789672628.148026:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789672628.148032:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564298496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789672628.148046:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672628.148072:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564298496:12345-0@lo:400:kworker.0 Request processed in 40us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672628.148077:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789672628.148080:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570f480 x1876607564298496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672628.148088:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564298496:0@lo:400:kworker.0 00000100:00100000:2.0:1789672628.148261:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564298368 00000100:00100000:2.0:1789672628.148266:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564298368 00000100:00100000:2.0:1789672628.148363:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789672628.148370:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564298368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672628.148414:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564298368:12345-0@lo:400:kworker.0 Request processed in 44us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672628.148421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789672628.148934:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672628.148962:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564298368:0@lo:400:kworker.0 00010000:00010000:0.0:1789672628.467359:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672629.498207:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789672629.786873:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000020:00000080:1.0:1789672629.786887:0:6710:0:(genops.c:885:class_export_put()) final put ffff9fa5022ab800/c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000020:00000080:1.0:1789672629.786917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa5022ab800/c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 for lustre-OST0000 00000020:00000080:1.0:1789672629.786972:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa5022ad800 for lustre-OST0000 00000100:00100000:0.0:1789672629.937257:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672629.937323:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672629.937326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294080 00000100:00100000:3.0:1789672629.937338:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294080 00000100:00100000:0.0:1789672629.937352:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672629.937374:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543293952 00000100:00100000:0.0:1789672629.937377:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543293952 00000100:00100000:3.0:1789672629.937399:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294208 00000100:00100000:3.0:1789672629.937402:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294208 00000100:00100000:0.0:1789672629.937407:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 226 00000100:00100000:0.0:1789672629.937416:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543293952:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672629.937445:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:3.0:1789672629.937452:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543294080:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672629.937498:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543293952:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672629.937520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 226 00000100:00100000:1.0:1789672629.937543:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 85 00000100:00100000:1.0:1789672629.937551:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543294208:12345-192.168.202.39@tcp:400:kworker.0 00000100:00080000:0.0:1789672629.937557:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672629.947187:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543294080:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 9722us (9926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672629.947203:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 84 00000020:00000080:3.0:1789672629.950175:0:11161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5d5d1cd0 20000000:00000080:3.0:1789672629.950194:0:11161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa62f5f6400 uarg=0000000000000000 20000000:01000000:3.0:1789672629.950233:0:11161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789672629.950239:0:11161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789672629.950244:0:11161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000100:00100000:1.0:1789672629.951771:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543294208:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 14210us (14407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672629.951806:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 85 00000040:00080000:1.0:1789672629.952530:0:11162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789672629.954126:0:11161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789672629.962024:0:11161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789672629.962232:0:11161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962269:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962279:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0887f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962287:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0888d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962381:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0889b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962464:0:11161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962471:0:11161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962593:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.962608:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 12 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.963093:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564298752:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672629.963216:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0889b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.963226:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0889b expref: 18 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.963248:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564298880:0@lo:104: 00000100:00100000:3.0:1789672629.963310:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672629.963356:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0888d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.963365:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0888d expref: 18 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.963373:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564299008:0@lo:104: 00000100:00100000:2.0:1789672629.963445:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564298880 00000100:00100000:3.0:1789672629.963487:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672629.963523:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0887f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672629.963532:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0887f expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.963537:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564298880 00000100:00100000:3.0:1789672629.963541:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564299136:0@lo:104: 00000100:00100000:3.0:1789672629.963575:0:11161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672629.963584:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299008 00000100:00100000:2.0:1789672629.963588:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299008 00010000:00010000:3.0:1789672629.963600:0:11161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.963603:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299136 00000100:00100000:2.0:1789672629.963607:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299136 00010000:00010000:3.0:1789672629.963616:0:11161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 12 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.963628:0:11161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564299264:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672629.963628:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672629.963637:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:11161:x1876607564298880:12345-0@lo:104: 00010000:00010000:2.0:1789672629.963649:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.963699:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672629.963706:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:11161:x1876607564298880:12345-0@lo:104: Request processed in 70us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672629.963722:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672629.963740:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672629.963746:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:11161:x1876607564299008:12345-0@lo:104: 00010000:00010000:2.0:1789672629.963754:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.964229:0:11161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789672629.964257:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564298880:0@lo:104: 00000100:00100000:3.0:1789672629.964281:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564299008:0@lo:104: 00010000:00010000:1.0:1789672629.964909:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672629.964914:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789672629.964919:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.964921:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:11161:x1876607564299008:12345-0@lo:104: Request processed in 1175us (1434us total) trans 0 rc 0/0 00010000:00010000:1.0:1789672629.964928:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030e00 already unused, calling callback (ffffffffc1db8c20) 00000100:00100000:2.0:1789672629.964929:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:00010000:1.0:1789672629.964932:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.964940:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.964953:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 10000000:00010000:1.0:1789672629.964956:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672629.964961:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789672629.964962:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:11161:x1876607564299136:12345-0@lo:104: 00010000:00010000:2.0:1789672629.964972:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.964997:0:8499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965002:0:8499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672629.965022:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.965028:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789672629.965030:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030e00/0x2247cb9491d0889b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.965032:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:11161:x1876607564299136:12345-0@lo:104: Request processed in 73us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672629.965038:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789672629.965043:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672629.965046:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965051:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600031800 already unused, calling callback (ffffffffc1db8c20) 00010000:00010000:2.0:1789672629.965052:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789672629.965054:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.965056:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965061:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.965063:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672629.965066:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672629.965068:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672629.965073:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672629.965084:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672629.965090:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965090:0:8499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672629.965097:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789672629.965097:0:8499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672629.965108:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965113:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.965114:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672629.965119:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600031800/0x2247cb9491d0888d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08894 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.965120:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.965127:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c200/0x2247cb9491d0887f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d08886 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965129:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672629.965131:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672629.965133:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672629.965140:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672629.965142:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672629.965143:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672629.965148:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672629.965153:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564299392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672629.965189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672629.965241:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564299520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672629.965264:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672629.965283:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672629.965288:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564299648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672629.965322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672629.965353:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299392 00000100:00100000:1.0:1789672629.965361:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299392 00010000:00010000:1.0:1789672629.965386:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0889b expref: 19 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672629.965403:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299520 00000100:00100000:1.0:1789672629.965406:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299520 00010000:00010000:1.0:1789672629.965429:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0888d expref: 20 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672629.965453:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299648 00000100:00100000:1.0:1789672629.965456:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299648 00010000:00010000:1.0:1789672629.965469:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0887f expref: 21 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672629.965480:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789672629.965485:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+21:3300:x1876607564299392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672629.965495:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672629.965500:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0889b expref: 21 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965508:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0889b expref: 21 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965521:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030a00/0x2247cb9491d088a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0889b expref: 21 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965534:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672629.965563:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+20:3300:x1876607564299392:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672629.965569:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789672629.965613:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789672629.965619:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564299520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672629.965626:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672629.965629:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0888d expref: 19 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965636:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0888d expref: 19 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965652:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031200/0x2247cb9491d08894 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0888d expref: 19 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965661:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672629.965687:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789672629.965687:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3301:x1876607564299520:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672629.965693:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672629.965696:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789672629.965705:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672629.965710:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564299648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672629.965717:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672629.965723:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0887f expref: 17 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965730:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0887f expref: 17 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672629.965739:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672629.965758:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564299648:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672629.965764:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672629.965813:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564299392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672629.965836:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564299648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672629.965844:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564299520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672629.965993:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d08886 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0887f expref: 16 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.966004:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564299136:0@lo:104: 00000100:00100000:0.0:1789672629.971666:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672629.971704:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672629.971862:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294464 00000100:00100000:2.0:1789672629.971872:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294464 00010000:00010000:2.0:1789672629.971914:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 13 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.971943:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294336 00000100:00100000:2.0:1789672629.971947:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294336 00010000:00010000:2.0:1789672629.971976:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 14 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.972000:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 28 00000100:00100000:2.0:1789672629.972009:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+14:2357:x1876607543294464:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672629.972027:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672629.972033:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 14 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.972045:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 14 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.972065:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672629.972082:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:0.0:1789672629.972095:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f8f297e-d024-4f2e-b44a-c373b0e97659+14:2357:x1876607543294336:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672629.972106:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672629.972112:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 14 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.972118:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+14:2357:x1876607543294464:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 107us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672629.972132:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 28 00010000:00010000:0.0:1789672629.972132:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 14 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972151:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972159:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972175:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972181:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972188:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972195:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972210:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672629.972215:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972223:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972233:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672629.972244:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672629.972266:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543294336:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 175us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672629.972274:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 29 00010000:00010000:3.0:1789672629.974568:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa642044e00/0x2247cb9491d088b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf759 expref: 12 pid: 5823 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672629.974590:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564298752:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672629.975371:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f2000/0x2247cb9491d08878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf721 expref: 11 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672629.975385:0:11161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11161:1876607564299264:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672629.975418:0:11161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.975428:0:11161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.975434:0:11161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672629.975473:0:11161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d088d3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672630.515686:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672631.085774:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672631.086074:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294592 00000100:00100000:3.0:1789672631.086089:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294592 00000100:00100000:3.0:1789672631.086157:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 227 00000100:00100000:3.0:1789672631.086170:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:5598:x1876607543294592:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672631.086193:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672631.086221:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf783 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.086263:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.086279:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.086300:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ca00, rc 0) 00000100:00100000:3.0:1789672631.086372:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543294592:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 206us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672631.086381:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 227 00000100:00100000:0.0:1789672631.093973:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672631.094022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294720 00000100:00100000:0.0:1789672631.094036:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294720 00000100:00100000:0.0:1789672631.094104:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 228 00000100:00100000:0.0:1789672631.094116:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543294720:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672631.094502:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543294720:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 387us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672631.094510:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 228 00000100:00100000:1.0:1789672631.103854:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672631.107896:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294848 00000100:00100000:3.0:1789672631.107918:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294848 00000100:00100000:3.0:1789672631.110994:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 229 00000100:00100000:3.0:1789672631.111017:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543294848:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.111993:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543294848:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 979us (8213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672631.112004:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 229 00000100:00100000:3.0:1789672631.125303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672631.125421:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543294976 00000100:00100000:1.0:1789672631.125452:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543294976 00000100:00100000:1.0:1789672631.125533:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 230 00000100:00100000:1.0:1789672631.125556:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543294976:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672631.125583:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672631.125609:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf78a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.125649:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.125665:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.125676:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f3600, rc 0) 00000100:00100000:1.0:1789672631.125755:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543294976:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 202us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672631.125763:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 230 00000100:00100000:3.0:1789672631.133458:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672631.133597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295104 00000100:00100000:2.0:1789672631.133611:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295104 00000100:00100000:2.0:1789672631.133695:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 231 00000100:00100000:2.0:1789672631.133708:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543295104:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672631.134146:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543295104:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 439us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672631.134155:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 231 00000100:00100000:2.0:1789672631.138304:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672631.139219:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295232 00000100:00100000:3.0:1789672631.139237:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295232 00000100:00100000:3.0:1789672631.139321:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 232 00000100:00100000:3.0:1789672631.139334:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543295232:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.139855:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543295232:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 521us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672631.139866:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 232 00000100:00100000:1.0:1789672631.219947:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564299776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672631.220053:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672631.220185:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299776 00000100:00100000:1.0:1789672631.220196:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299776 00000100:00100000:1.0:1789672631.220268:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789672631.220279:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564299776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672631.220339:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672631.220394:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564299776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672631.220401:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789672631.220444:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672631.220494:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa607b4c700 x1876607564299776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672631.220516:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564299776:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789672631.539033:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672631.539043:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa63fb87000 from 7 10000000:01000000:2.0:1789672631.539050:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672631.539114:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672631.539131:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672631.539145:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672631.539176:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564299904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672631.539256:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672631.539315:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564299904 00000100:00100000:1.0:1789672631.539326:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564299904 00000100:00100000:2.0:1789672631.539331:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789672631.539393:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00010000:00010000:3.0:1789672631.539402:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672631.539405:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564299904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672631.539422:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672631.539438:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d088e8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.540446:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.540466:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.540534:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa6208f3000, rc 0) 00000100:00100000:1.0:1789672631.540852:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564299904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1447us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672631.540863:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789672631.541458:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564299904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672631.542276:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672631.542301:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672631.542424:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672631.542506:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672631.542757:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789672631.543393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300032 00000100:00100000:3.0:1789672631.543407:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300032 00000100:00100000:3.0:1789672631.543585:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789672631.543598:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564300032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.544076:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564300032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 469us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672631.544086:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789672631.544195:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.544252:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.544323:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672631.544863:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672631.546459:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300160 00000100:00100000:2.0:1789672631.546644:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300160 00000100:00100000:2.0:1789672631.546720:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789672631.547036:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564300160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672631.547373:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564300160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 642us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672631.547381:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789672631.547947:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789672631.550192:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789672631.550430:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789672631.550468:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789672631.550488:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.550503:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672631.550516:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789672631.550520:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6117c1000 from 7 10000000:01000000:3.0:1789672631.550523:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672631.550934:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.550947:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.550961:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672631.550995:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.551166:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672631.551268:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672631.551326:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300288 00000100:00100000:0.0:1789672631.551337:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300288 00000100:00100000:0.0:1789672631.551442:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789672631.551453:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564300288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672631.551491:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672631.551509:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d088f6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672631.551548:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672631.551562:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672631.551573:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044600, rc 0) 00000100:00100000:0.0:1789672631.551632:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564300288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672631.551640:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789672631.551771:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672631.551814:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.551825:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672631.551902:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.551943:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672631.552540:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672631.552611:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300416 00000100:00100000:0.0:1789672631.552618:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300416 00000100:00100000:0.0:1789672631.552647:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789672631.552667:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564300416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672631.553047:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564300416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 381us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672631.553056:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789672631.553583:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.553641:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672631.553920:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672631.553998:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672631.554031:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300544 00000100:00100000:0.0:1789672631.554037:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300544 00000100:00100000:0.0:1789672631.554180:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789672631.554191:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564300544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672631.554454:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564300544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672631.554480:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789672631.554634:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789672631.566391:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789672631.566768:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789672631.567043:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672631.567059:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.567088:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672631.567102:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672631.567106:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa604b25800 from 7 10000000:01000000:1.0:1789672631.567109:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672631.567161:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.567171:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.567184:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672631.567219:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.567327:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672631.567390:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742300 going to sleep for 11 seconds 00000100:00100000:3.0:1789672631.567513:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300672 00000100:00100000:3.0:1789672631.567524:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300672 00000100:00100000:3.0:1789672631.567593:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789672631.567605:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564300672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672631.567623:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672631.567639:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08904 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.569182:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08904 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.569203:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08904 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672631.569215:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67dc00, rc 0) 00000100:00100000:3.0:1789672631.569319:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564300672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1714us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672631.569328:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789672631.569507:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672631.569531:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672631.569543:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672631.569647:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.570131:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672631.570177:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672631.570198:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300800 00000100:00100000:1.0:1789672631.570206:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300800 00000100:00100000:1.0:1789672631.570249:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789672631.570259:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564300800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.570629:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564300800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672631.570637:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789672631.572932:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.573014:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672631.573104:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672631.573160:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672631.573873:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564300928 00000100:00100000:2.0:1789672631.573885:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564300928 00000100:00100000:2.0:1789672631.573945:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789672631.573956:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564300928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672631.574226:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564300928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672631.574234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789672631.576000:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564300928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789672631.578132:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789672631.578428:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789672631.578453:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672631.578538:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672631.578553:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672632.563872:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672633.267000:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564301056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672633.267100:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672633.267187:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301056 00000100:00100000:0.0:1789672633.267194:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301056 00000100:00100000:0.0:1789672633.267250:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789672633.267260:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564301056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672633.267307:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672633.267351:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564301056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672633.267358:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789672633.267382:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789672633.267414:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570ca80 x1876607564301056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672633.267431:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564301056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672633.267602:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564301312:0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.267645:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672633.267666:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789672633.267671:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564301184:0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.267698:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672633.267721:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564301696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.267742:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672633.267770:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301184 00000100:00100000:3.0:1789672633.267774:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301184 00000100:00100000:3.0:1789672633.267827:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789672633.267834:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.267871:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564301184:12345-0@lo:400:kworker.0 Request processed in 37us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672633.267877:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789672633.267904:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301312 00000100:00100000:3.0:1789672633.267908:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301312 00000100:00100000:3.0:1789672633.267931:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301696 00000100:00100000:3.0:1789672633.267934:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301696 00000100:00100000:3.0:1789672633.267959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789672633.267966:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564301312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.267996:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564301312:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672633.268002:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789672633.268014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789672633.268020:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564301696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.268045:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564301696:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672633.268059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789672633.268095:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564301184:0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.268104:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564301696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.268111:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564301312:0@lo:400:kworker.0 00000100:00100000:0.0:1789672633.268363:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564301440:0@lo:400:kworker.0 00000100:00100000:0.0:1789672633.268394:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672633.268424:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672633.268430:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564301568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672633.268454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789672633.268479:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672633.268541:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301568 00000100:00100000:3.0:1789672633.268546:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301568 00000100:00100000:3.0:1789672633.268604:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789672633.268611:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564301568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.268645:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564301568:12345-0@lo:400:kworker.0 Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672633.268651:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789672633.268669:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301440 00000100:00100000:3.0:1789672633.268672:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301440 00000100:00100000:3.0:1789672633.268695:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789672633.268703:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564301440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672633.268731:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564301440:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672633.268736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789672633.268859:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672633.268863:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672633.268884:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa609f6d500 x1876607564301568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672633.268904:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564301568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672633.268915:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564301440:0@lo:400:kworker.0 00010000:00010000:2.0:1789672633.595551:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789672634.524088:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789672634.612945:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672635.049112:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672635.049160:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672635.049204:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672635.049392:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295360 00000100:00100000:0.0:1789672635.049392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295616 00000100:00100000:1.0:1789672635.049402:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295360 00000100:00100000:0.0:1789672635.049402:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295616 00000100:00100000:1.0:1789672635.049455:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 243 00000100:00100000:0.0:1789672635.049461:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295488 00000100:00100000:1.0:1789672635.049464:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543295360:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672635.049464:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295488 00000100:00100000:0.0:1789672635.049485:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 89 00000100:00100000:0.0:1789672635.049491:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543295616:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672635.049531:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543295616:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 39us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672635.049538:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 89 00000100:00080000:2.0:1789672635.049554:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672635.049555:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 90 00000100:00100000:0.0:1789672635.049561:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543295488:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672635.049615:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543295360:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 152us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672635.049623:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 243 00000100:00100000:0.0:1789672635.056222:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543295488:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 6644us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672635.056239:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 90 00010000:00010000:0.0:1789672635.635111:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672636.341124:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564301824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672636.341309:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672636.341410:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301824 00000100:00100000:3.0:1789672636.341421:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301824 00000100:00100000:3.0:1789672636.341497:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789672636.341509:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564301824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672636.341568:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672636.341627:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564301824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672636.341635:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789672636.341688:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa609f6ca80 x1876607564301824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672636.341711:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564301824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789672636.348520:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789672636.668391:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672637.688881:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672638.387079:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564302080:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672638.387262:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564302592:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672638.387330:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789672638.387337:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564301952:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672638.387405:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564302464:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387429:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672638.387456:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564302208:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672638.387500:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672638.387505:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564302336:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387528:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672638.387566:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302080 00000100:00100000:3.0:1789672638.387577:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302080 00000100:00100000:3.0:1789672638.387650:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302464 00000100:00100000:3.0:1789672638.387653:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302464 00000100:00100000:3.0:1789672638.387677:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302208 00000100:00100000:3.0:1789672638.387680:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302208 00000100:00100000:3.0:1789672638.387716:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789672638.387726:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564302080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387812:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564302080:12345-0@lo:400:kworker.0 Request processed in 87us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.387820:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789672638.387840:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672638.387846:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564302464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387874:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564302464:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.387881:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672638.387892:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789672638.387898:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564302208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.387926:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564302208:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.387932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789672638.387950:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302592 00000100:00100000:3.0:1789672638.387954:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302592 00000100:00100000:3.0:1789672638.387982:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302336 00000100:00100000:3.0:1789672638.387984:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302336 00000100:00100000:3.0:1789672638.388004:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789672638.388011:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564302592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388042:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564302592:12345-0@lo:400:kworker.0 Request processed in 32us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.388058:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789672638.388070:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789672638.388076:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564302336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388103:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564302336:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.388109:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789672638.388129:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564301952 00000100:00100000:3.0:1789672638.388133:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564301952 00000100:00100000:3.0:1789672638.388155:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789672638.388162:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564301952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388190:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564301952:12345-0@lo:400:kworker.0 Request processed in 29us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.388196:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:3.0:1789672638.388281:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa609f6df80 x1876607564302336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672638.388299:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564302336:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388310:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564302208:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388340:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564301952:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388349:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564302464:0@lo:400:kworker.0 00000100:00100000:3.0:1789672638.388359:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564302080:0@lo:400:kworker.0 00010000:00080000:3.0:1789672638.388369:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa609f6c000 x1876607564302592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672638.388378:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564302592:0@lo:400:kworker.0 00000100:00080000:2.0:1789672638.388649:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672638.388655:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672638.388658:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672638.403293:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564302720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672638.403405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672638.403489:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302720 00000100:00100000:2.0:1789672638.403500:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302720 00000100:00100000:2.0:1789672638.403592:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789672638.403676:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564302720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672638.414834:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672638.414973:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564302720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11294us (11561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672638.414986:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789672638.415094:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bdb480 x1876607564302720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672638.415123:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564302720:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789672638.632346:0:11461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:17:17 (1789672637) === 00010000:00010000:0.0:1789672638.709366:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672638.915660:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672638.915761:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672638.915834:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295872 00000100:00100000:0.0:1789672638.915845:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295872 00000100:00100000:0.0:1789672638.915909:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:0.0:1789672638.915918:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7225c799-181e-4570-897c-b66842e45960+6:9674:x1876607543295872:12345-192.168.202.39@tcp:700:mkdir.0 00000100:00100000:0.0:1789672638.916014:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7225c799-181e-4570-897c-b66842e45960+6:9674:x1876607543295872:12345-192.168.202.39@tcp:700:mkdir.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672638.916021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00080000:0.0:1789672638.916044:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672638.916308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543295744 00000100:00100000:3.0:1789672638.916314:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543295744 00000100:00100000:3.0:1789672638.916355:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:3.0:1789672638.916363:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543295744:12345-192.168.202.39@tcp:41:mkdir.0 00000004:00000024:3.0:1789672638.916398:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789672638.916468:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543295744:12345-192.168.202.39@tcp:41:mkdir.0 Request processed in 105us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.916475:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:0.0:1789672638.930258:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672638.930330:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543296128 00000100:00100000:3.0:1789672638.930340:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543296128 00000100:00100000:3.0:1789672638.930403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:3.0:1789672638.930413:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+6:9674:x1876607543296128:12345-192.168.202.39@tcp:36:mkdir.0 00010000:00010000:3.0:1789672638.930477:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672638.930701:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa600031c00/0x2247cb9491d087f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf70c expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.930721:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05a00) 00010000:00010000:3.0:1789672638.930734:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672638.931200:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.931228:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.931240:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.931272:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.931287:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.931294:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672638.933399:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789672638.933416:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.933427:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.933435:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.933441:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672638.933446:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.933454:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.933468:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330200) 00010000:00010000:3.0:1789672638.933471:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672638.933476:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.933483:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08912 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672638.933516:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064972d48 reply state 000000009d353d64 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672638.933524:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672638.933628:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+7:9674:x1876607543296128:12345-192.168.202.39@tcp:36:mkdir.0 Request processed in 3213us (3376us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789672638.933636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00010000:00010000:0.0:1789672638.940595:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672638.940614:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672638.940622:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672638.940628:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67da00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672638.940633:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672638.940642:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672638.940657:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa611330100) 00010000:00010000:0.0:1789672638.940660:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672638.940665:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672638.940671:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08919 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672638.952734:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672638.953244:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543296256 00000100:00100000:3.0:1789672638.953265:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543296256 00000100:00100000:3.0:1789672638.953363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:3.0:1789672638.953378:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:9675:x1876607543296256:12345-192.168.202.39@tcp:101:chmod.0 00010000:00010000:3.0:1789672638.953411:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672638.953444:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf791 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.953539:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08927 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.953557:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.953572:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672638.953615:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789672638.953619:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672638.953670:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.953734:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf791 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.953756:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf791 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672638.953765:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330200) 00010000:00010000:3.0:1789672638.953768:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672638.953772:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67cc00, rc 0) 00000100:00100000:3.0:1789672638.953914:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:9675:x1876607543296256:12345-192.168.202.39@tcp:101:chmod.0 Request processed in 541us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672638.953922:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:1.0:1789672638.961908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672638.962825:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543296512 00000100:00100000:2.0:1789672638.962837:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543296512 00000100:00100000:2.0:1789672638.962961:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:2.0:1789672638.962972:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+7:9675:x1876607543296512:12345-192.168.202.39@tcp:36:chmod.0 00010000:00010000:2.0:1789672638.963028:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672638.963068:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08927 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf791 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672638.963087:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330200) 00010000:00010000:2.0:1789672638.963098:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672638.963126:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672638.963138:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672638.963148:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672638.963867:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d05e9ae4 reply state 0000000015b59b28 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672638.963880:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789672638.963890:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789672638.963991:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+8:9675:x1876607543296512:12345-192.168.202.39@tcp:36:chmod.0 Request processed in 1020us (2091us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789672638.964000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00010000:00010000:1.0:1789672638.970966:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672638.970986:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672638.970994:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672638.971000:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672638.971005:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672638.971013:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672638.971149:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa60bce6900) 00010000:00010000:1.0:1789672638.971154:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672638.971160:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672638.971167:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d0892e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672639.012357:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672639.012480:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543296640 00000100:00100000:0.0:1789672639.012490:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543296640 00000100:00100000:0.0:1789672639.012555:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:0.0:1789672639.012565:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+7:9676:x1876607543296640:12345-192.168.202.39@tcp:101:chown.0 00010000:00010000:0.0:1789672639.012587:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672639.012611:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d08935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf798 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.012675:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d0893c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.012701:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d0893c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.012713:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d0893c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672639.012747:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789672639.012751:0:7918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672639.012824:0:7918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d0893c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.012852:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d08935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf798 expref: 9 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.012870:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d0893c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf798 expref: 8 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.012879:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672639.012881:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672639.012898:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044800, rc 0) 00000100:00100000:0.0:1789672639.012962:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+8:9676:x1876607543296640:12345-192.168.202.39@tcp:101:chown.0 Request processed in 398us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672639.012969:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:3.0:1789672639.019645:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672639.019914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543296768 00000100:00100000:0.0:1789672639.019926:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543296768 00000100:00100000:0.0:1789672639.020181:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:0.0:1789672639.020193:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+8:9676:x1876607543296768:12345-192.168.202.39@tcp:101:chown.0 00010000:00010000:0.0:1789672639.020225:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672639.020244:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044200/0x2247cb9491d08943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf79f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020310:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020324:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020337:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020373:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020381:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020479:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020568:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020583:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020591:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672639.020620:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789672639.020624:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672639.020641:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020652:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020659:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020666:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020672:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672639.020676:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020830:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020844:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672639.020846:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672639.020851:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020866:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d0894a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020882:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020888:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020894:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020899:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672639.020902:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020907:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020914:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa610c05c00) 00010000:00010000:0.0:1789672639.020916:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672639.020918:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020924:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08951 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020963:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044200/0x2247cb9491d08943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf79f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020978:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf79f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.020990:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672639.020992:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672639.020994:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911a00, rc 0) 00000100:00100000:0.0:1789672639.021048:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+9:9676:x1876607543296768:12345-192.168.202.39@tcp:101:chown.0 Request processed in 858us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672639.021054:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:1.0:1789672639.033432:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672639.033582:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543297024 00000100:00100000:0.0:1789672639.033594:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543297024 00000100:00100000:0.0:1789672639.033661:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:0.0:1789672639.033673:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+9:9676:x1876607543297024:12345-192.168.202.39@tcp:36:chown.0 00010000:00010000:0.0:1789672639.033739:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672639.033765:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf79f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.033833:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672639.033845:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672639.033871:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.033884:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.033893:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672639.103529:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789672639.104115:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aea4ccb0 reply state 00000000831872c0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672639.104155:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789672639.104172:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789672639.104300:0:7918:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789672639.104324:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+7:9676:x1876607543297024:12345-192.168.202.39@tcp:36:chown.0 Request processed in 70649us (70898us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789672639.104333:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00010000:00010000:1.0:1789672639.104421:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672639.104431:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672639.104450:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672639.104457:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672639.104462:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672639.104469:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672639.104493:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa610c05c00) 00010000:00010000:1.0:1789672639.104496:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672639.104501:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672639.104507:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0895f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672639.157535:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672639.158448:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543297152 00000100:00100000:2.0:1789672639.158483:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543297152 00000100:00100000:2.0:1789672639.158561:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:2.0:1789672639.158571:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:9677:x1876607543297152:12345-192.168.202.39@tcp:101:touch.500 00010000:00010000:2.0:1789672639.158596:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672639.158619:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7a6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672639.168893:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 10120us 00010000:00010000:2.0:1789672639.198260:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198293:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198307:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198325:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198339:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198651:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d0897b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198660:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d0897b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198668:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d0897b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672639.198699:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789672639.198702:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672639.198738:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d0897b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198749:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198756:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198763:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198768:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.198772:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198779:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672639.198822:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.198828:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198834:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d0896d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198856:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198872:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198878:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198882:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.198885:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198891:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198899:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa60bce6e00) 00010000:00010000:2.0:1789672639.198902:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.198905:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198911:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198952:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7a6 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198967:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d0897b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7a6 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.198974:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:2.0:1789672639.198976:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789672639.198985:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ee00, rc 0) 00000100:00100000:2.0:1789672639.199058:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+7:9677:x1876607543297152:12345-192.168.202.39@tcp:101:touch.500 Request processed in 40487us (41537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672639.199067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:1.0:1789672639.208108:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.208585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543297408 00000100:00100000:3.0:1789672639.208597:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543297408 00000100:00100000:3.0:1789672639.208665:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:3.0:1789672639.208676:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:9677:x1876607543297408:12345-192.168.202.39@tcp:101:touch.500 00010000:00010000:3.0:1789672639.208699:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672639.208723:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08982 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.209059:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.209076:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.209098:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.209114:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.209122:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.209130:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672639.209929:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789672639.210223:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210235:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210247:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210282:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210290:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210296:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210302:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672639.210312:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210320:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210334:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:3.0:1789672639.210337:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672639.210343:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210349:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d08989 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672639.210362:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a467381a reply state 00000000d1ebb3f9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672639.210371:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789672639.210406:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08982 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7ad expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210421:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7ad expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.210429:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330d00) 00010000:00010000:3.0:1789672639.210431:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672639.210434:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67de00, rc 0) 00000100:00100000:3.0:1789672639.210507:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+10:9677:x1876607543297408:12345-192.168.202.39@tcp:101:touch.500 Request processed in 1832us (2407us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789672639.210515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:1.0:1789672639.216677:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.216769:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543297664 00000100:00100000:3.0:1789672639.216781:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543297664 00000100:00100000:3.0:1789672639.216875:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:3.0:1789672639.216886:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+10:9677:x1876607543297664:12345-192.168.202.39@tcp:36:touch.500 00010000:00010000:3.0:1789672639.216945:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672639.216971:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08997 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7ad expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.216991:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330d00) 00010000:00010000:3.0:1789672639.217002:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672639.217053:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.217067:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.217079:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672639.217247:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008733b819 reply state 00000000b0b92c7c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672639.217267:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672639.217363:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+11:9677:x1876607543297664:12345-192.168.202.39@tcp:36:touch.500 Request processed in 478us (694us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789672639.217371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 23 00010000:00010000:0.0:1789672639.223098:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.223117:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.223125:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.223131:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672639.223136:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.223143:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.223164:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff9fa611330800) 00010000:00010000:0.0:1789672639.223167:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672639.223172:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672639.223177:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08990 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672639.229674:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.229764:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543297792 00000100:00100000:3.0:1789672639.229775:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543297792 00000100:00100000:3.0:1789672639.229872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:3.0:1789672639.229884:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+10:9677:x1876607543297792:12345-192.168.202.39@tcp:101:touch.500 00010000:00010000:3.0:1789672639.229926:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672639.229948:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d089ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7b4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.230011:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d089ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7b4 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.230027:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d089ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7b4 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.230047:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330a00) 00010000:00010000:3.0:1789672639.230050:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672639.230054:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672639.230119:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+11:9677:x1876607543297792:12345-192.168.202.39@tcp:101:touch.500 Request processed in 238us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672639.230127:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 24 00010000:00010000:2.0:1789672639.230217:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.230227:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.230233:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.230239:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.230244:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.230251:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.230262:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330a00) 00010000:00010000:2.0:1789672639.230264:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.230268:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.230273:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d089a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672639.235098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.235197:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543297920 00000100:00100000:3.0:1789672639.235217:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543297920 00000100:00100000:3.0:1789672639.235272:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:3.0:1789672639.235289:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1876607543297920:12345-192.168.202.39@tcp:8:touch.500 00010000:00080000:3.0:1789672639.235325:0:8063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:3.0:1789672639.235361:0:8063:0:(genops.c:1384:class_connect()) connect: client 7225c799-181e-4570-897c-b66842e45960, cookie 0x2247cb9491d089b3 00002000:00100000:3.0:1789672639.235374:0:8063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7225c799-181e-4570-897c-b66842e45960/ffff9fa63adc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789672639.235385:0:8063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789672639.235635:0:8063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789672639.235666:0:8063:0:(import.c:65:import_set_state_nolock()) ffff9fa63adc4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672639.235762:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:2356:x1876607543297920:12345-192.168.202.39@tcp:8:touch.500 Request processed in 480us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672639.235771:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:1.0:1789672639.241360:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.241686:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543298048 00000100:00100000:3.0:1789672639.241697:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543298048 00000100:00100000:3.0:1789672639.241775:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:3.0:1789672639.241825:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:0:x1876607543298048:12345-192.168.202.39@tcp:2:touch.500 00000100:00080000:0.0:1789672639.242399:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672639.364580:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:0:x1876607543298048:12345-192.168.202.39@tcp:2:touch.500 Request processed in 122785us (123219us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789672639.364595:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00000001:00080000:3.0:1789672639.364644:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789672639.364655:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000100:00100000:0.0:1789672639.375877:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672639.376133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543298304 00000100:00100000:1.0:1789672639.376144:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543298304 00000100:00100000:1.0:1789672639.376213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:1.0:1789672639.376225:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+10:9677:x1876607543298304:12345-192.168.202.39@tcp:35:touch.500 00000100:00100000:1.0:1789672639.376749:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+11:9677:x1876607543298304:12345-192.168.202.39@tcp:35:touch.500 Request processed in 524us (880us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789672639.376770:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:1.0:1789672639.409492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.409606:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543298432 00000100:00100000:3.0:1789672639.409616:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543298432 00000100:00100000:3.0:1789672639.409683:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:3.0:1789672639.409693:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+11:9678:x1876607543298432:12345-192.168.202.39@tcp:101:rm.0 00010000:00010000:3.0:1789672639.409717:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672639.409738:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d089ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7bb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.409858:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d089c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.409872:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d089c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.409884:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d089c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672639.409939:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789672639.409942:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672639.409980:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d089c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.410007:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d089ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7bb expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.410025:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d089c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7bb expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.410034:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:3.0:1789672639.410037:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672639.410040:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:3.0:1789672639.410094:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+12:9678:x1876607543298432:12345-192.168.202.39@tcp:101:rm.0 Request processed in 402us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672639.410101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:3.0:1789672639.414489:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672639.420175:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543298688 00000100:00100000:2.0:1789672639.420193:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543298688 00000100:00100000:2.0:1789672639.420445:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:2.0:1789672639.420457:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+12:9678:x1876607543298688:12345-192.168.202.39@tcp:101:rm.0 00010000:00010000:2.0:1789672639.420492:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672639.420514:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d089c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7c2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672639.420602:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789672639.420758:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d089c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7c2 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.420771:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672639.420810:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672639.420816:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d089c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7c2 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.420831:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ec00, rc 0) 00000100:00100000:2.0:1789672639.420906:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+13:9678:x1876607543298688:12345-192.168.202.39@tcp:101:rm.0 Request processed in 451us (6426us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789672639.420913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:0.0:1789672639.430142:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672639.430270:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543298816 00000100:00100000:1.0:1789672639.430348:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543298816 00000100:00100000:1.0:1789672639.430441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:1.0:1789672639.430452:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+13:9678:x1876607543298816:12345-192.168.202.39@tcp:37:rm.0 00000100:00100000:2.0:1789672639.435033:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+13:9678:x1876607543298816:12345-192.168.202.39@tcp:37:rm.0 Request processed in 4566us (4886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672639.435049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:3.0:1789672639.446987:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672639.447168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543299072 00000100:00100000:0.0:1789672639.447180:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543299072 00000100:00100000:0.0:1789672639.447257:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:0.0:1789672639.447268:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+13:9678:x1876607543299072:12345-192.168.202.39@tcp:35:rm.0 00000100:00100000:0.0:1789672639.447549:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+14:9678:x1876607543299072:12345-192.168.202.39@tcp:35:rm.0 Request processed in 282us (570us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789672639.447556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:0.0:1789672639.452159:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.452271:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543299328 00000100:00100000:3.0:1789672639.452353:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543299328 00000100:00100000:3.0:1789672639.452545:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:3.0:1789672639.452557:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+14:9678:x1876607543299328:12345-192.168.202.39@tcp:101:rm.0 00010000:00010000:3.0:1789672639.452586:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672639.452612:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d089d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7c9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.452743:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d089dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.452758:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d089dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.452769:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d089dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672639.452782:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789672639.452990:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d089d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7c9 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.453009:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d089dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7c9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.453018:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:3.0:1789672639.453021:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789672639.453024:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d600, rc 0) 00000100:00100000:3.0:1789672639.453094:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543299328:12345-192.168.202.39@tcp:101:rm.0 Request processed in 540us (944us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789672639.453101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:1.0:1789672639.461920:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.462178:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543299456 00000100:00100000:3.0:1789672639.462189:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543299456 00000100:00100000:3.0:1789672639.462261:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 28 00000100:00100000:3.0:1789672639.462271:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543299456:12345-192.168.202.39@tcp:41:rm.0 00000004:00000024:3.0:1789672639.462343:0:7918:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1789672639.462429:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543299456:12345-192.168.202.39@tcp:41:rm.0 Request processed in 159us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672639.462437:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 28 00000100:00100000:1.0:1789672639.467263:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672639.467364:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543299584 00000100:00100000:2.0:1789672639.467373:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543299584 00000100:00100000:2.0:1789672639.467443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:2.0:1789672639.467453:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543299584:12345-192.168.202.39@tcp:101:rm.0 00010000:00010000:2.0:1789672639.467474:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672639.467496:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d089eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467581:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467596:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467607:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467621:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467627:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467633:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467753:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467762:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467768:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672639.467842:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789672639.467847:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672639.467866:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467888:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467896:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467902:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467908:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467914:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.467918:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467926:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467939:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:2.0:1789672639.467942:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.467947:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467954:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d089f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467967:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467973:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467986:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467991:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.467993:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.467999:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.468007:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff9fa60bce6e00) 00010000:00010000:2.0:1789672639.468010:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.468013:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.468019:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d089f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.468050:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d089eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7d0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.468064:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7d0 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.468071:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330a00) 00010000:00010000:2.0:1789672639.468073:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672639.468075:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ea00, rc 0) 00000100:00100000:2.0:1789672639.468143:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+17:9678:x1876607543299584:12345-192.168.202.39@tcp:101:rm.0 Request processed in 691us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672639.468157:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:0.0:1789672639.473720:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672639.474178:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543299840 00000100:00100000:3.0:1789672639.474189:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543299840 00000100:00100000:3.0:1789672639.474259:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:3.0:1789672639.474270:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+17:9678:x1876607543299840:12345-192.168.202.39@tcp:36:rm.0 00010000:00010000:3.0:1789672639.474325:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789672639.474353:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7d0 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474375:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d089ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7b4 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474398:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330a00) 00010000:00010000:3.0:1789672639.474416:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d089c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7bb expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474424:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:3.0:1789672639.474428:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672639.474448:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474461:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474472:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474507:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474515:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474522:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474657:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474666:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.474672:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672639.479714:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789672639.479739:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308260952025ns, next at 309260947018ns, rc = 0 00010000:00010000:3.0:1789672639.479881:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.479898:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.479910:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.479920:0:7918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.479944:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.479951:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.479972:0:7918:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672639.479994:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480000:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480006:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480012:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672639.480017:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480024:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480036:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330700) 00010000:00010000:3.0:1789672639.480039:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789672639.480045:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480052:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a15 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480072:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480084:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480090:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480095:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67de00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672639.480098:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480104:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480112:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:3.0:1789672639.480114:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672639.480118:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.480123:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d08a07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672639.480134:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b5b1331 reply state 000000005245ecee transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672639.480143:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672639.480244:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543299840:12345-192.168.202.39@tcp:36:rm.0 Request processed in 5974us (6531us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789672639.480253:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 30 00010000:00010000:2.0:1789672639.480649:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672639.480656:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.480663:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67cc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672639.480667:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.480673:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.480694:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa611330700) 00010000:00010000:2.0:1789672639.480696:0:8499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789672639.480700:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.480706:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08a1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.480724:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672639.480726:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672639.480728:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672639.487925:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672639.488011:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300096 00000100:00100000:0.0:1789672639.488022:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300096 00000100:00100000:0.0:1789672639.488081:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:0.0:1789672639.488092:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543300096:12345-192.168.202.39@tcp:35:rm.0 00000100:00100000:0.0:1789672639.488360:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+17:9678:x1876607543300096:12345-192.168.202.39@tcp:35:rm.0 Request processed in 268us (443us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789672639.488367:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00010000:00010000:3.0:1789672639.488757:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.488823:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.488832:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.488837:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672639.488842:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.488851:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.488868:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff9fa611330d00) 00010000:00010000:3.0:1789672639.488871:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672639.488876:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.488883:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672639.500379:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672639.500533:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300352 00000100:00100000:2.0:1789672639.500544:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300352 00000100:00100000:2.0:1789672639.500604:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:2.0:1789672639.500614:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+16:9678:x1876607543300352:12345-192.168.202.39@tcp:36:rm.0 00010000:00010000:2.0:1789672639.500678:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789672639.500713:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d089dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7c9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500754:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d0897b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7a6 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500766:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:2.0:1789672639.500782:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d0893c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf798 expref: 14 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500830:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672639.500837:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672639.500860:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500872:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500882:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500895:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500902:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.500909:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501141:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501160:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501168:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672639.501770:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789672639.501827:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501836:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501843:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501849:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.501854:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501862:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501872:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa60bce6900) 00010000:00010000:2.0:1789672639.501875:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789672639.501879:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501884:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08a31 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501904:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501917:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501924:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501929:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.501932:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501937:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501946:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa60bce6e00) 00010000:00010000:2.0:1789672639.501948:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.501951:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.501955:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08a23 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672639.501968:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b758ab5 reply state 00000000adb5b0cb transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672639.501977:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672639.502052:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+15:9678:x1876607543300352:12345-192.168.202.39@tcp:36:rm.0 Request processed in 1439us (1681us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789672639.502060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00010000:00010000:2.0:1789672639.504517:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.504548:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.504555:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.504561:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672639.504566:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.504574:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.504589:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa60bce6c00) 00010000:00010000:2.0:1789672639.504592:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672639.504597:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672639.504603:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08a2a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672639.731169:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672640.174364:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672640.174416:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672640.174462:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672640.174557:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672640.174655:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300736 00000100:00100000:3.0:1789672640.174667:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300736 00000100:00100000:3.0:1789672640.174733:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:3.0:1789672640.174744:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543300736:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672640.174853:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543300736:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 112us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672640.174861:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:0.0:1789672640.175903:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300480 00000100:00100000:0.0:1789672640.175917:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300480 00000100:00100000:0.0:1789672640.175969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 245 00000100:00100000:0.0:1789672640.175978:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543300480:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672640.176026:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543300480:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 50us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672640.176046:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 245 00000100:00100000:2.0:1789672640.184554:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300608 00000100:00100000:2.0:1789672640.184572:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300608 00000100:00100000:2.0:1789672640.184651:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300864 00000100:00100000:2.0:1789672640.184654:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300864 00000100:00100000:2.0:1789672640.184691:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 94 00000100:00100000:2.0:1789672640.184701:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+14:2359:x1876607543300608:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672640.184829:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+14:2359:x1876607543300608:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 129us (10365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672640.184855:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 94 00000100:00100000:2.0:1789672640.184875:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 95 00000100:00100000:2.0:1789672640.184881:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543300864:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672640.184909:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543300864:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 28us (10352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672640.184915:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 95 00000100:00080000:0.0:1789672640.185356:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672640.763569:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672641.465473:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564302848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672641.465775:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672641.468335:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302848 00000100:00100000:2.0:1789672641.468354:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302848 00000100:00100000:2.0:1789672641.468645:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789672641.468657:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564302848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672641.468716:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672641.468858:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564302848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672641.468866:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789672641.468901:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672641.472940:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641b31880 x1876607564302848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672641.472978:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564302848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672641.780594:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672642.803280:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672643.507020:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564303104:0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.507124:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672643.507215:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564303616:0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.507243:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672643.507276:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789672643.507282:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564302976:0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.507313:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672643.507335:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564303488:0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.508266:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672643.508325:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564303232:0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.508658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672643.508689:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672643.508696:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564303360:0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.508735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672643.508777:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303104 00000100:00100000:3.0:1789672643.508814:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303104 00000100:00100000:3.0:1789672643.508873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303488 00000100:00100000:3.0:1789672643.508876:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303488 00000100:00100000:3.0:1789672643.508901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303232 00000100:00100000:3.0:1789672643.508921:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303232 00000100:00100000:3.0:1789672643.508942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672643.508951:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564303104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.509015:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564303104:12345-0@lo:400:kworker.0 Request processed in 65us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672643.509024:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672643.509043:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789672643.509049:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564303488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.509075:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564303488:12345-0@lo:400:kworker.0 Request processed in 26us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672643.509082:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789672643.509091:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789672643.509096:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564303232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672643.509122:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564303232:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672643.509129:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789672643.509559:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303616 00000100:00100000:1.0:1789672643.509566:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303616 00000100:00100000:3.0:1789672643.509830:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564302976 00000100:00100000:3.0:1789672643.509836:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564302976 00000004:00080000:2.0:1789672643.510005:0:8061:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312291217549ns, next at 313291214422ns, rc = 0 00000100:00100000:1.0:1789672643.517616:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303360 00000100:00100000:1.0:1789672643.517652:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303360 00000100:00100000:1.0:1789672643.518003:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672643.518018:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564303616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672643.518158:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564303616:12345-0@lo:400:kworker.0 Request processed in 133us (10901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672643.518176:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672643.518198:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789672643.518205:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672643.518239:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564303360:12345-0@lo:400:kworker.0 Request processed in 35us (9504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672643.518261:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672643.519497:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564303488:0@lo:400:kworker.0 00000100:00100000:2.0:1789672643.519519:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564303104:0@lo:400:kworker.0 00010000:00080000:2.0:1789672643.519548:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa609f6ca80 x1876607564303616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672643.519560:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564303616:0@lo:400:kworker.0 00000100:00080000:2.0:1789672643.519600:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672643.519622:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672643.519627:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672643.520230:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672643.520256:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672643.520354:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789672643.520929:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa609f6d880 x1876607564303360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672643.520944:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564303360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672643.520959:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564303232:0@lo:400:kworker.0 00000100:00100000:2.0:1789672643.523205:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789672643.523231:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564302976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672643.523370:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564302976:12345-0@lo:400:kworker.0 Request processed in 153us (16055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672643.523379:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789672643.523476:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564302976:0@lo:400:kworker.0 00000100:00100000:0.0:1789672643.524005:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303744 00000100:00100000:0.0:1789672643.524016:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303744 00000100:00100000:1.0:1789672643.524204:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789672643.524214:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564303744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672643.524254:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672643.524329:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564303744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (3983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672643.524336:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789672643.524408:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bdb480 x1876607564303744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672643.524429:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564303744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789672643.827173:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672644.174605:0:11611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1789672644.626826:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1789672644.626851:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789672644.626871:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789672644.626880:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789672644.627141:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564303872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789672644.627221:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672644.627287:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564303872 00000100:00100000:2.0:1789672644.627295:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564303872 00000100:00100000:2.0:1789672644.627537:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672644.627548:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564303872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789672644.627575:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789672644.627609:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aac3cbf, atime: 0x6aac3cbf, ctime: 0x6aac3cbf, blocks: 0x1 00010000:00010000:2.0:1789672644.627618:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672644.627645:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789672644.627650:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672644.627656:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672644.627675:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672644.627686:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672644.627694:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672644.627721:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672644.628497:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672644.628506:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672644.628515:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672644.628520:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672644.628529:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672644.628550:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672644.628559:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d08a38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672644.628577:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672644.628579:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672644.628587:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672644.629130:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564303872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1581us (1906us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789672644.629140:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1789672644.629312:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa502bbbb80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789672644.629320:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564303872:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789672644.851959:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789672645.227759:0:11661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe88225ec0 20000000:00000080:0.0:1789672645.227778:0:11661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa63f7b3000 uarg=0000000000000000 20000000:01000000:0.0:1789672645.227990:0:11661:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789672645.227997:0:11661:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789672645.228002:0:11661:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789672645.228989:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789672645.229165:0:11661:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789672645.238728:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789672645.239039:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789672645.239112:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789672645.239131:0:11661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789672645.239164:0:11661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239183:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239192:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239200:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239206:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239213:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08904 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239232:0:11661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239272:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d08904 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239301:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d08904 expref: 18 pid: 5823 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672645.239316:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304000:0@lo:104: 00000100:00100000:0.0:1789672645.239391:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672645.239451:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239459:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672645.239467:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304128:0@lo:104: 00000100:00100000:0.0:1789672645.239635:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672645.239753:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.239763:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 18 pid: 5825 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672645.239772:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304256:0@lo:104: 00000100:00100000:0.0:1789672645.239815:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672645.241856:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.241893:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 12 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672645.241907:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304384:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672645.241985:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.241993:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672645.242001:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304512:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672645.242028:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672645.242566:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789672645.242583:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564304000 00000100:00100000:3.0:1789672645.242591:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564304000 00000100:00100000:3.0:1789672645.242642:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564304128 00000100:00100000:3.0:1789672645.242646:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564304128 00000100:00100000:3.0:1789672645.242657:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564304256 00000100:00100000:3.0:1789672645.242660:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564304256 00000100:00100000:3.0:1789672645.242674:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672645.242682:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:11661:x1876607564304000:12345-0@lo:104: 00010000:00010000:3.0:1789672645.242698:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.242803:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672645.242810:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+5:11661:x1876607564304000:12345-0@lo:104: Request processed in 128us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672645.242817:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672645.242834:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672645.242841:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:11661:x1876607564304128:12345-0@lo:104: 00010000:00010000:3.0:1789672645.242849:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.242888:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789672645.242893:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+4:11661:x1876607564304128:12345-0@lo:104: Request processed in 53us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672645.242898:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672645.242909:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789672645.242915:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:11661:x1876607564304256:12345-0@lo:104: 00010000:00010000:3.0:1789672645.242923:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.242953:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789672645.242963:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+3:11661:x1876607564304256:12345-0@lo:104: Request processed in 48us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672645.242970:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789672645.243007:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789672645.243012:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243020:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6208f2000 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672645.243025:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243034:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672645.243042:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672645.243048:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672645.243075:0:8499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243082:0:8499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672645.243100:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243107:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f2000/0x2247cb9491d08904 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0890b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243121:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789672645.243123:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243139:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672645.243141:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243147:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672645.243165:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672645.243169:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672645.243183:0:8499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243189:0:8499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672645.243195:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243201:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d088f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088fd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243210:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672645.243212:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243217:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672645.243220:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243235:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672645.243240:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672645.243245:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672645.243258:0:8499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.243264:0:8499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672645.243453:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672645.243617:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304000:0@lo:104: 00000100:00100000:0.0:1789672645.243629:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304128:0@lo:104: 00000100:00100000:0.0:1789672645.243636:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304256:0@lo:104: 00000100:00100000:2.0:1789672645.243737:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1789672645.243967:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa608071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564304640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672645.244014:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672645.244058:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672645.244065:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564304768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672645.244088:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672645.244122:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672645.244171:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564304640 00000100:00100000:1.0:1789672645.244177:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564304640 00010000:00010000:1.0:1789672645.244207:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08904 expref: 19 pid: 5823 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672645.244237:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564304768 00000100:00100000:1.0:1789672645.244240:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564304768 00010000:00010000:1.0:1789672645.244252:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 20 pid: 5824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672645.244704:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789672645.244713:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+20:3299:x1876607564304640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672645.244728:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672645.244734:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d08904 expref: 20 pid: 5823 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.244748:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d08904 expref: 20 pid: 5823 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.244764:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0890b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d08904 expref: 20 pid: 5823 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.244810:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672645.244851:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564304640:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672645.244857:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789672645.244874:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789672645.244881:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3299:x1876607564304768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672645.244888:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672645.244892:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.244901:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.244910:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa642044600/0x2247cb9491d088fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d088f6 expref: 18 pid: 5824 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.244918:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672645.244940:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3299:x1876607564304768:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672645.244946:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1789672645.245078:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.245088:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d088e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d088ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672645.245101:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672645.245103:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672645.245105:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672645.245121:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564304896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672645.245162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672645.245465:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564304896 00000100:00100000:0.0:1789672645.245471:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564304896 00010000:00010000:0.0:1789672645.245503:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 17 pid: 5825 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672645.245534:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672645.245541:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3301:x1876607564304896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672645.245550:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672645.245555:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 17 pid: 5825 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.245564:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 17 pid: 5825 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.245575:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3000/0x2247cb9491d088ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d088e8 expref: 17 pid: 5825 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.245584:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672645.245617:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3301:x1876607564304896:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672645.245624:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672645.246008:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304384:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672645.246020:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876607564304512:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672645.246050:0:11661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672645.246130:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564304768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672645.246138:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa608071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564304640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672645.246634:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564304896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672645.251099:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672645.251248:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672645.252043:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301120 00000100:00100000:0.0:1789672645.252056:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301120 00000100:00100000:1.0:1789672645.252131:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543300992 00000100:00100000:1.0:1789672645.252135:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543300992 00010000:00010000:1.0:1789672645.252186:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672645.252252:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:1.0:1789672645.252262:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f8f297e-d024-4f2e-b44a-c373b0e97659+14:2358:x1876607543300992:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672645.252603:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672645.252610:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.252624:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.252642:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3600/0x2247cb9491d088e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf78a expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672645.252658:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672645.252724:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2358:x1876607543300992:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 462us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672645.252732:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 33 00010000:00010000:2.0:1789672645.253286:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672645.253320:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:2.0:1789672645.253612:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:2358:x1876607543301120:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672645.253625:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672645.253632:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253643:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253656:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d088da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf783 expref: 12 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253670:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253679:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253695:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253703:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253710:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253717:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253723:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672645.253728:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253744:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253765:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672645.253775:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672645.253843:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:2358:x1876607543301120:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 234us (2754us total) trans 0 rc 0/0 00010000:00010000:0.0:1789672645.254030:0:11661:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.254040:0:11661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672645.254053:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa61d911400/0x2247cb9491d08a3f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672645.258062:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:2.0:1789672645.292275:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672645.292317:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672645.292369:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672645.292397:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301248 00000100:00100000:2.0:1789672645.292406:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301248 00000100:00100000:2.0:1789672645.292468:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301504 00000100:00100000:2.0:1789672645.292471:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301504 00000100:00100000:2.0:1789672645.292511:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 99 00000100:00100000:2.0:1789672645.292521:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543301248:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672645.292600:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543301248:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672645.292608:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 99 00000100:00100000:2.0:1789672645.292625:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 100 00000100:00100000:2.0:1789672645.292632:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543301504:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672645.292657:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543301504:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672645.292677:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 100 00000100:00080000:2.0:1789672645.292696:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672645.293650:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301376 00000100:00100000:1.0:1789672645.293662:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301376 00000100:00100000:1.0:1789672645.293730:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:1.0:1789672645.293741:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543301376:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672645.293814:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543301376:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 75us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672645.293821:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00080000:2.0:1789672645.295062:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789672645.874932:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672646.579088:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564305024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672646.579188:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672646.580609:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305024 00000100:00100000:3.0:1789672646.580621:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305024 00000100:00100000:3.0:1789672646.580715:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789672646.580727:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564305024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672646.580766:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672646.580880:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564305024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672646.580887:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789672646.581050:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672646.581157:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639d4ed80 x1876607564305024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672646.581179:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564305024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672646.765687:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672646.765862:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301632 00000100:00100000:3.0:1789672646.765872:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301632 00000100:00100000:3.0:1789672646.765932:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 247 00000100:00100000:3.0:1789672646.765942:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:5598:x1876607543301632:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672646.765959:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672646.765979:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67d400/0x2247cb9491d08a46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7d7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672646.766010:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67d400/0x2247cb9491d08a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7d7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672646.766022:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67d400/0x2247cb9491d08a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7d7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672646.766031:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d400, rc 0) 00000100:00100000:3.0:1789672646.766089:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543301632:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 149us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672646.766096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 247 00000100:00100000:1.0:1789672646.769113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672646.769238:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301760 00000100:00100000:2.0:1789672646.769249:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301760 00000100:00100000:2.0:1789672646.769300:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 248 00000100:00100000:2.0:1789672646.769309:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543301760:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672646.769608:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543301760:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 298us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672646.769616:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 248 00000100:00100000:2.0:1789672646.779926:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672646.780042:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543301888 00000100:00100000:1.0:1789672646.780065:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543301888 00000100:00100000:1.0:1789672646.780120:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 249 00000100:00100000:1.0:1789672646.780130:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543301888:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672646.780356:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543301888:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 227us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672646.780365:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 249 00000100:00100000:1.0:1789672646.787275:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672646.787363:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302016 00000100:00100000:3.0:1789672646.787374:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302016 00000100:00100000:3.0:1789672646.787426:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 250 00000100:00100000:3.0:1789672646.787437:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:9948:x1876607543302016:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672646.787687:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:9948:x1876607543302016:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 251us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672646.787717:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 250 00000100:00100000:3.0:1789672646.792524:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672646.792729:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302144 00000100:00100000:2.0:1789672646.792740:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302144 00000100:00100000:2.0:1789672646.792819:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 251 00000100:00100000:2.0:1789672646.792829:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:9948:x1876607543302144:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672646.793088:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:9948:x1876607543302144:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 258us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672646.793097:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 251 00000100:00100000:2.0:1789672646.814398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672646.814497:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302272 00000100:00100000:1.0:1789672646.814508:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302272 00000100:00100000:1.0:1789672646.814565:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 252 00000100:00100000:1.0:1789672646.814575:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:5598:x1876607543302272:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672646.814592:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672646.814622:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d08a4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7de expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672646.814652:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d08a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7de expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672646.814663:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d08a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7de expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672646.814672:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542ee00, rc 0) 00000100:00100000:1.0:1789672646.814744:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543302272:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 171us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672646.814751:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 252 00000100:00100000:2.0:1789672646.830235:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672646.830335:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302400 00000100:00100000:3.0:1789672646.830347:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302400 00000100:00100000:3.0:1789672646.830403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 253 00000100:00100000:3.0:1789672646.830413:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543302400:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672646.830732:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543302400:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 319us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672646.830741:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 253 00000100:00100000:3.0:1789672646.858682:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672646.858855:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302528 00000100:00100000:2.0:1789672646.858867:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302528 00000100:00100000:2.0:1789672646.858925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 254 00000100:00100000:2.0:1789672646.858936:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543302528:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672646.859191:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:5598:x1876607543302528:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 256us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672646.859199:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 254 00000100:00100000:2.0:1789672646.868091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672646.868209:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302656 00000100:00100000:0.0:1789672646.868221:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302656 00000100:00100000:0.0:1789672646.868280:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 255 00000100:00100000:0.0:1789672646.868291:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:9951:x1876607543302656:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789672646.868546:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa618741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:9951:x1876607543302656:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 257us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672646.868554:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 255 00000100:00100000:1.0:1789672646.872349:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672646.872475:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302784 00000100:00100000:3.0:1789672646.872486:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302784 00000100:00100000:3.0:1789672646.872543:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 256 00000100:00100000:3.0:1789672646.872553:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:9951:x1876607543302784:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672646.873034:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:9951:x1876607543302784:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 479us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672646.873043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 256 00010000:00010000:2.0:1789672646.899051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789672647.091992:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672647.092000:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa63fb87000 from 7 10000000:01000000:0.0:1789672647.092006:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672647.092056:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.092070:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.092082:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672647.092153:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.092225:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.092277:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7429c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672647.092471:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305152 00000100:00100000:2.0:1789672647.092480:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305152 00000100:00100000:2.0:1789672647.092535:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789672647.092544:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:5827:x1876607564305152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672647.092558:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672647.092572:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929e000/0x2247cb9491d08a5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08a54 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672647.092595:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929e000/0x2247cb9491d08a5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08a54 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672647.092617:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929e000/0x2247cb9491d08a5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08a54 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672647.092626:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929e000, rc 0) 00000100:00100000:2.0:1789672647.092669:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564305152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672647.092675:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789672647.092980:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672647.092995:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.093005:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672647.093068:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.093097:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.093141:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672647.093272:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305280 00000100:00100000:1.0:1789672647.093285:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305280 00000100:00100000:1.0:1789672647.093398:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789672647.093407:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564305280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672647.095036:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564305280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1624us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672647.095047:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789672647.100814:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.100891:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.100969:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.101020:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672647.101485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305408 00000100:00100000:3.0:1789672647.101493:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305408 00000100:00100000:3.0:1789672647.101553:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789672647.101562:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564305408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672647.101824:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564305408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672647.101832:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789672647.102450:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.103593:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11674:1876607564305536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672647.103669:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.104470:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672647.107475:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305536 00000100:00100000:1.0:1789672647.107493:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305536 00000100:00100000:1.0:1789672647.107568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789672647.107578:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:11674:x1876607564305536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672647.108626:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:11674:x1876607564305536:12345-0@lo:502:llog_process_th.0 Request processed in 1046us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672647.108636:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789672647.113762:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11674:1876607564305536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672647.114015:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672647.114040:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672647.114043:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789672647.114051:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa63fb87000 00000020:00000080:0.0:1789672647.114054:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789672647.115277:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11674:1876607564305664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672647.115448:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.115554:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a742480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672647.123456:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305664 00000100:00100000:1.0:1789672647.123472:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305664 00000100:00100000:1.0:1789672647.123540:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789672647.123551:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:11674:x1876607564305664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672647.124520:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:11674:x1876607564305664:12345-0@lo:502:llog_process_th.0 Request processed in 967us (9069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672647.124530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789672647.131030:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11674:1876607564305664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672647.131075:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672647.131083:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672647.131085:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789672647.131089:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789672647.143990:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789672647.144030:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672647.144043:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.144058:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672647.144088:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672647.144091:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6117c1000 from 7 10000000:01000000:1.0:1789672647.144094:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672647.144149:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.144157:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.144168:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672647.144194:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672647.144258:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672647.144308:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa609214180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672647.144474:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305792 00000100:00100000:3.0:1789672647.144482:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305792 00000100:00100000:3.0:1789672647.144540:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789672647.144551:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:5827:x1876607564305792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672647.144566:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672647.144580:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d08a69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08a62 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672647.144604:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d08a69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08a62 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672647.144627:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d08a69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08a62 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672647.144635:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67de00, rc 0) 00000100:00100000:3.0:1789672647.144675:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564305792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672647.144681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789672647.145229:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672647.145247:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.145256:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672647.145396:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672647.145430:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672647.147093:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa609214180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672647.152591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564305920 00000100:00100000:0.0:1789672647.152604:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564305920 00000100:00100000:3.0:1789672647.155127:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789672647.155157:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564305920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672647.155532:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564305920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (10099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672647.155541:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000040:00080000:1.0:1789672647.160184:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672647.162912:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a259f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564305920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672647.162995:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672647.163078:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672647.163146:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63518c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672647.163475:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306048 00000100:00100000:3.0:1789672647.163481:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306048 00000100:00100000:3.0:1789672647.163530:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789672647.163539:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564306048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672647.163849:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564306048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672647.163861:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789672647.163912:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672647.164114:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11678:1876607564306176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672647.164164:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672647.164191:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcd480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672647.165230:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306176 00000100:00100000:1.0:1789672647.165248:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306176 00000100:00100000:1.0:1789672647.165296:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789672647.165306:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:11678:x1876607564306176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672647.165525:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:11678:x1876607564306176:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672647.165535:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789672647.165557:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11678:1876607564306176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672647.165592:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672647.165603:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672647.165606:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789672647.165614:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa6117c1000 00000020:00000080:2.0:1789672647.165617:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789672647.165698:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11678:1876607564306304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672647.165743:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672647.165768:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306304 00000100:00100000:2.0:1789672647.165773:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306304 00000100:00100000:2.0:1789672647.165976:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789672647.165985:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:11678:x1876607564306304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672647.166148:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:11678:x1876607564306304:12345-0@lo:502:llog_process_th.0 Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672647.166157:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789672647.166321:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789672647.166338:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11678:1876607564306304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672647.166359:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672647.166364:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672647.166366:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789672647.166370:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789672647.166452:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789672647.166481:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672647.166492:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.166505:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672647.166517:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672647.166520:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa604b25800 from 7 10000000:01000000:0.0:1789672647.166523:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672647.166550:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.166560:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.166583:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672647.166600:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.166634:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.166664:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672647.166826:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306432 00000100:00100000:1.0:1789672647.166832:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306432 00000100:00100000:1.0:1789672647.166866:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789672647.166874:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:5827:x1876607564306432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672647.166884:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672647.166896:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542e600/0x2247cb9491d08a77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d08a70 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.166921:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542e600/0x2247cb9491d08a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d08a70 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.166933:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542e600/0x2247cb9491d08a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d08a70 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672647.166943:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e600, rc 0) 00000100:00100000:1.0:1789672647.166974:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6103a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564306432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672647.166981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789672647.167067:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672647.167080:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672647.167090:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672647.167147:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.167173:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672647.167209:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672647.167223:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306560 00000100:00100000:0.0:1789672647.167226:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306560 00000100:00100000:0.0:1789672647.167262:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789672647.167270:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564306560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.167513:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564306560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672647.167522:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789672647.167837:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672647.167872:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672647.167912:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672647.167953:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672647.168007:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306688 00000100:00100000:0.0:1789672647.168012:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306688 00000100:00100000:0.0:1789672647.168047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789672647.168060:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564306688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672647.169394:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:5827:x1876607564306688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1328us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672647.169407:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789672647.177572:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3c6595f6-f042-46a8-abe4-2c10b8a32248:5827:1876607564306688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672647.179757:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a258380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11680:1876607564306816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672647.179879:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672647.179922:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672647.180023:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306816 00000100:00100000:2.0:1789672647.180032:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306816 00000100:00100000:2.0:1789672647.180085:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789672647.180094:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:11680:x1876607564306816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672647.180460:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:11680:x1876607564306816:12345-0@lo:502:llog_process_th.0 Request processed in 365us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672647.180476:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789672647.180665:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a258380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11680:1876607564306816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672647.180707:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672647.180717:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672647.180719:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672647.180727:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa604b25800 00000020:00000080:1.0:1789672647.180729:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672647.180945:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a258380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11680:1876607564306944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672647.180985:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672647.181014:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672647.185266:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564306944 00000100:00100000:1.0:1789672647.185281:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564306944 00000100:00100000:1.0:1789672647.185350:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789672647.185363:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:11680:x1876607564306944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672647.185618:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:11680:x1876607564306944:12345-0@lo:502:llog_process_th.0 Request processed in 259us (4632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672647.185626:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789672647.185688:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a258380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3c6595f6-f042-46a8-abe4-2c10b8a32248:11680:1876607564306944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672647.185721:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672647.185729:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672647.185731:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789672647.185735:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789672647.186523:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789672647.186546:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672647.186556:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672647.186569:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672647.925997:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672648.180476:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789672648.627646:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564307456:0@lo:400:kworker.0 00000100:00100000:3.0:1789672648.627695:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564307200:0@lo:400:kworker.0 00000100:00100000:0.0:1789672648.627716:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672648.627783:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672648.627808:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564307328:0@lo:400:kworker.0 00000100:00100000:0.0:1789672648.627836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672648.627870:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307456 00000100:00100000:0.0:1789672648.627878:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307456 00000100:00100000:0.0:1789672648.627937:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789672648.627947:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564307456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672648.627999:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564307456:12345-0@lo:400:kworker.0 Request processed in 54us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672648.628006:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789672648.628029:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307328 00000100:00100000:0.0:1789672648.628033:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307328 00000100:00100000:0.0:1789672648.628061:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789672648.628067:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564307328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672648.628096:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564307328:12345-0@lo:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672648.628101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789672648.628116:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672648.628129:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672648.628162:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564307328:0@lo:400:kworker.0 00010000:00080000:0.0:1789672648.628191:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa502bba680 x1876607564307456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672648.628201:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564307456:0@lo:400:kworker.0 00000100:00100000:1.0:1789672648.628296:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564307072:0@lo:400:kworker.0 00000100:00100000:1.0:1789672648.628340:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672648.628372:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564307584:0@lo:400:kworker.0 00000100:00100000:1.0:1789672648.628394:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672648.628436:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307584 00000100:00100000:1.0:1789672648.628440:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307584 00000100:00100000:1.0:1789672648.628472:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789672648.628479:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564307584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672648.628512:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564307584:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672648.628517:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789672648.628537:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672648.628553:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564307584:0@lo:400:kworker.0 00000100:00100000:3.0:1789672648.628877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672648.628883:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307072 00000100:00100000:0.0:1789672648.628887:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307072 00000100:00100000:0.0:1789672648.628919:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789672648.628926:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564307072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672648.628953:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564307712:0@lo:400:kworker.0 00000100:00100000:0.0:1789672648.628959:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564307072:12345-0@lo:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672648.628964:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789672648.628974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672648.628986:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672648.628993:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564307840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672648.629015:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672648.629240:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307712 00000100:00100000:1.0:1789672648.629245:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307712 00000100:00100000:1.0:1789672648.629287:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789672648.629295:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564307712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672648.629342:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564307712:12345-0@lo:400:kworker.0 Request processed in 48us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672648.629348:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789672648.629380:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564307072:0@lo:400:kworker.0 00000100:00080000:0.0:1789672648.629495:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672648.629712:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307840 00000100:00100000:3.0:1789672648.629717:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307840 00000100:00100000:3.0:1789672648.629753:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789672648.629760:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564307840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672648.629814:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672648.629855:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564307840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672648.629862:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789672648.629892:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564307712:0@lo:400:kworker.0 00000100:00100000:1.0:1789672648.630069:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564307840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672648.630751:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307200 00000100:00100000:2.0:1789672648.630757:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307200 00000100:00100000:2.0:1789672648.630817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789672648.630827:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564307200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672648.630889:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564307200:12345-0@lo:400:kworker.0 Request processed in 65us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672648.630895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789672648.630980:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564307200:0@lo:400:kworker.0 00010000:00010000:1.0:1789672648.946952:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789672649.748260:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1789672649.972905:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672650.417894:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672650.417949:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672650.417987:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672650.418032:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672650.418383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303040 00000100:00100000:0.0:1789672650.418397:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303040 00000100:00100000:0.0:1789672650.418483:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303296 00000100:00100000:0.0:1789672650.418487:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303296 00000100:00100000:0.0:1789672650.418516:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 104 00000100:00100000:0.0:1789672650.418528:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543303040:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672650.418629:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543303040:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 104us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672650.418637:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 104 00000100:00100000:0.0:1789672650.418657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 105 00000100:00100000:0.0:1789672650.418664:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543303296:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672650.418701:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543303296:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 38us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672650.418709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 105 00000100:00100000:0.0:1789672650.418731:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303168 00000100:00100000:0.0:1789672650.418736:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303168 00000100:00100000:0.0:1789672650.418770:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:0.0:1789672650.418778:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543303168:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672650.418851:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543303168:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 73us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672650.418857:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:2.0:1789672650.418992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543302912 00000100:00100000:2.0:1789672650.418997:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543302912 00000100:00100000:2.0:1789672650.419035:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 273 00000100:00100000:2.0:1789672650.419042:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543302912:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672650.419071:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543302912:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 30us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672650.419077:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 273 00000100:00080000:3.0:1789672650.419346:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672650.419352:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672650.998069:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672651.699392:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564307968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672651.699517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672651.699698:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564307968 00000100:00100000:3.0:1789672651.699710:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564307968 00000100:00100000:3.0:1789672651.699816:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789672651.699828:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564307968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672651.699878:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672651.699937:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564307968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672651.699944:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789672651.700127:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f527100 x1876607564307968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672651.700151:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564307968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789672651.700229:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789672652.019298:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672653.043258:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672653.748493:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564308480:0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.748600:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672653.748712:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672653.748721:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564308352:0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.748758:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672653.748827:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308480 00000100:00100000:1.0:1789672653.748848:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308480 00000100:00100000:1.0:1789672653.748928:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789672653.748940:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564308480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.749005:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564308480:12345-0@lo:400:kworker.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672653.749013:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789672653.749039:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672653.749099:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f524a80 x1876607564308480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672653.749117:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564308480:0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.749169:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564308224:0@lo:400:kworker.0 00000100:00100000:0.0:1789672653.749196:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308352 00000100:00100000:1.0:1789672653.749202:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672653.749205:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308352 00000100:00100000:0.0:1789672653.749251:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308224 00000100:00100000:0.0:1789672653.749254:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308224 00000100:00100000:0.0:1789672653.749279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672653.749289:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564308352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672653.749334:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564308352:12345-0@lo:400:kworker.0 Request processed in 48us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672653.749340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672653.749355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789672653.749361:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564308224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672653.749389:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564308224:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672653.749394:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789672653.749412:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672653.749461:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564308224:0@lo:400:kworker.0 00000100:00100000:0.0:1789672653.749468:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564308352:0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.749474:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564308736:0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.749513:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672653.749552:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789672653.749560:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564308096:0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.749589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672653.749674:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308736 00000100:00100000:1.0:1789672653.749679:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564308608:0@lo:400:kworker.0 00000100:00100000:0.0:1789672653.749680:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308736 00000100:00100000:1.0:1789672653.749712:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672653.749728:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789672653.749738:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564308736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672653.749746:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308096 00000100:00100000:1.0:1789672653.749752:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308096 00000100:00100000:1.0:1789672653.749808:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789672653.749816:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564308096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789672653.752836:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672653.752877:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308608 00000100:00100000:2.0:1789672653.752910:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308608 00000100:00100000:2.0:1789672653.752995:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789672653.753004:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564308608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672653.753704:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672653.753723:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672653.756731:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564308736:12345-0@lo:400:kworker.0 Request processed in 6977us (7199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672653.756770:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789672653.757084:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789672653.757093:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa502bbbb80, transno 4294967300 00000100:00100000:0.0:1789672653.757116:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564308736:0@lo:400:kworker.0 00000100:00080000:0.0:1789672653.759426:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672653.759886:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672653.759947:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308864 00000100:00100000:3.0:1789672653.759959:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308864 00000100:00100000:0.0:1789672653.759974:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564308096:0@lo:400:kworker.0 00000100:00100000:3.0:1789672653.760033:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789672653.760045:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564308864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672653.760045:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789672653.760058:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1789672653.760119:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672653.760170:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564308864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672653.760179:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789672653.760517:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672653.760593:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564308096:12345-0@lo:400:kworker.0 Request processed in 9783us (10007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672653.760606:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789672653.763595:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564308608:12345-0@lo:400:kworker.0 Request processed in 10578us (13868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672653.763627:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672653.764407:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564308608:0@lo:400:kworker.0 00010000:00010000:3.0:1789672654.068201:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672655.091071:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672655.533150:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672655.533209:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672655.533253:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672655.533303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672655.533349:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303552 00000100:00100000:1.0:1789672655.533362:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303552 00000100:00100000:1.0:1789672655.533435:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303808 00000100:00100000:1.0:1789672655.533439:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303808 00000100:00100000:1.0:1789672655.533466:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 109 00000100:00100000:1.0:1789672655.533478:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543303552:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672655.533772:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303680 00000100:00100000:2.0:1789672655.533778:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303680 00000100:00100000:2.0:1789672655.533869:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672655.533888:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543303680:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672655.533971:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543303680:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 86us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672655.533979:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672655.534008:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 110 00000100:00100000:2.0:1789672655.534018:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543303808:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672655.534046:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543303808:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 30us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672655.534062:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 110 00000100:00100000:1.0:1789672655.534688:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543303552:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 1207us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672655.534698:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 109 00000100:00100000:0.0:1789672655.534989:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303424 00000100:00100000:0.0:1789672655.534997:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303424 00000100:00100000:0.0:1789672655.535041:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 275 00000100:00100000:0.0:1789672655.535050:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543303424:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672655.535097:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543303424:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 48us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672655.535104:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 275 00000100:00080000:0.0:1789672655.535150:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672655.535156:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672656.115128:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672656.819283:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564308992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672656.819373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672656.819493:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564308992 00000100:00100000:1.0:1789672656.819502:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564308992 00000100:00100000:1.0:1789672656.819580:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789672656.819590:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564308992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672656.819632:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789672656.819708:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672656.820623:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564308992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1031us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672656.820632:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789672656.820702:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e17800 x1876607564308992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672656.820724:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564308992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672657.139030:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672658.162952:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672658.419474:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789672658.867631:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564309504:0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.867633:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564309248:0@lo:400:kworker.0 00000100:00100000:3.0:1789672658.867719:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564309120:0@lo:400:kworker.0 00000100:00100000:2.0:1789672658.867723:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564309376:0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.868316:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672658.868371:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564309760:0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.868397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672658.868443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309248 00000100:00100000:1.0:1789672658.868450:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309248 00000100:00100000:1.0:1789672658.868494:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672658.868503:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564309248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.868554:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564309248:12345-0@lo:400:kworker.0 Request processed in 51us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672658.868561:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672658.868583:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309760 00000100:00100000:1.0:1789672658.868587:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309760 00000100:00100000:1.0:1789672658.868708:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789672658.868716:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564309760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.868747:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564309760:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672658.868768:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789672658.868801:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672658.868845:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564309248:0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.868855:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564309760:0@lo:400:kworker.0 00000100:00100000:0.0:1789672658.870223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672658.870428:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672658.870468:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564309632:0@lo:400:kworker.0 00000100:00100000:3.0:1789672658.870496:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672658.870714:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309120 00000100:00100000:0.0:1789672658.870722:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309120 00000100:00100000:0.0:1789672658.870776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789672658.870779:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309504 00000100:00100000:0.0:1789672658.870807:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564309120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672658.870856:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564309120:12345-0@lo:400:kworker.0 Request processed in 72us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672658.870863:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789672658.870880:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309504 00000100:00100000:0.0:1789672658.870904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309632 00000100:00100000:0.0:1789672658.870908:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309632 00000100:00100000:1.0:1789672658.870931:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789672658.870942:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564309504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672658.870953:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789672658.870963:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564309632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672658.870993:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564309504:12345-0@lo:400:kworker.0 Request processed in 53us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672658.871001:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789672658.871005:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564309632:12345-0@lo:400:kworker.0 Request processed in 43us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672658.871031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1789672658.871055:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672658.871060:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672658.871089:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa502bb9c00 x1876607564309504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672658.871103:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564309504:0@lo:400:kworker.0 00000100:00100000:2.0:1789672658.871137:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672658.871163:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564309888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672658.871163:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309376 00000100:00100000:0.0:1789672658.871169:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309376 00000100:00100000:2.0:1789672658.871198:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672658.871216:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789672658.871225:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564309376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672658.871250:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564309888 00000100:00100000:2.0:1789672658.871262:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564309888 00000100:00100000:0.0:1789672658.871263:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564309376:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672658.871271:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1789672658.871287:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672658.871298:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789672658.871306:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564309888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672658.871333:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672658.871364:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564309888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672658.871370:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789672658.871394:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564309376:0@lo:400:kworker.0 00000100:00100000:2.0:1789672658.871408:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564309888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672658.871565:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564309120:0@lo:400:kworker.0 00000100:00100000:3.0:1789672658.871575:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564309632:0@lo:400:kworker.0 00010000:00010000:2.0:1789672659.187745:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672660.211385:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672660.653038:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672660.653167:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672660.653447:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543303936 00000100:00100000:3.0:1789672660.653460:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543303936 00000100:00100000:3.0:1789672660.653530:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 277 00000100:00100000:3.0:1789672660.653543:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543303936:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672660.653656:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543303936:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 115us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672660.653665:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 277 00000100:00100000:0.0:1789672660.654519:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304064 00000100:00100000:0.0:1789672660.654530:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304064 00000100:00100000:0.0:1789672660.654618:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:0.0:1789672660.654629:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543304064:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672660.654696:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543304064:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 69us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672660.654703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00080000:2.0:1789672660.654817:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672660.662840:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672660.663109:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672660.663330:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304320 00000100:00100000:0.0:1789672660.663343:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304320 00000100:00100000:0.0:1789672660.663432:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:0.0:1789672660.663442:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543304320:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672660.663539:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543304320:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 97us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672660.663557:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00080000:1.0:1789672660.664050:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672660.664623:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304192 00000100:00100000:2.0:1789672660.664633:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304192 00000100:00100000:2.0:1789672660.664748:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:2.0:1789672660.664759:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2356:x1876607543304192:12345-192.168.202.39@tcp:9:kworker.0 00000020:00000080:2.0:1789672660.664809:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d089b3 00000100:00080000:2.0:1789672660.664823:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fa63adc4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789672660.664887:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789672660.665493:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+2:2356:x1876607543304192:12345-192.168.202.39@tcp:9:kworker.0 Request processed in 733us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672660.665503:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00010000:00010000:3.0:1789672660.665725:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789672660.669764:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789672661.236118:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672661.941553:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564310016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672661.941659:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672661.941761:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310016 00000100:00100000:1.0:1789672661.941845:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310016 00000100:00080000:2.0:1789672661.941946:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672661.941972:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789672661.941983:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564310016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672661.942044:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672661.942102:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564310016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672661.942109:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789672661.942153:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa639e16a00 x1876607564310016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672661.942177:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564310016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672662.260245:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672663.283328:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672663.987187:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564310272:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.987512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.987594:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564310784:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.987631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.987666:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789672663.987674:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564310144:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.987708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.987742:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564310656:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.987766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.987892:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310272 00000100:00100000:1.0:1789672663.987902:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310272 00000100:00100000:1.0:1789672663.987963:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310656 00000100:00100000:1.0:1789672663.987967:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310656 00000100:00100000:1.0:1789672663.989403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672663.989421:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564310272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672663.989432:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310784 00000100:00100000:2.0:1789672663.989444:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310784 00000100:00100000:2.0:1789672663.989506:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789672663.989517:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564310784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.989536:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564310272:12345-0@lo:400:kworker.0 Request processed in 121us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672663.989545:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789672663.989571:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564310784:12345-0@lo:400:kworker.0 Request processed in 55us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672663.989571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789672663.989586:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789672663.989586:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564310656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.989625:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564310656:12345-0@lo:400:kworker.0 Request processed in 45us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672663.989633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789672663.989856:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564310656:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.989870:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564310784:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.989883:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564310272:0@lo:400:kworker.0 00000100:00100000:3.0:1789672663.989911:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310144 00000100:00100000:3.0:1789672663.989919:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310144 00000100:00100000:3.0:1789672663.989959:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789672663.989967:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564310144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672663.990040:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564310144:12345-0@lo:400:kworker.0 Request processed in 73us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672663.990047:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789672663.990463:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564310144:0@lo:400:kworker.0 00000100:00080000:1.0:1789672663.990630:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672663.990637:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672663.990742:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564310528:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.990815:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.990855:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789672663.990863:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564310400:0@lo:400:kworker.0 00000100:00100000:1.0:1789672663.990888:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.990905:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564310912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672663.990928:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672663.990959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310400 00000100:00100000:1.0:1789672663.990964:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310400 00000100:00100000:1.0:1789672663.991024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789672663.991032:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564310400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672663.991376:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310912 00000100:00100000:0.0:1789672663.991383:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310912 00000100:00100000:0.0:1789672663.991443:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789672663.991445:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564310400:12345-0@lo:400:kworker.0 Request processed in 410us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672663.991455:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1789672663.991756:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672663.991808:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564310528 00000100:00100000:2.0:1789672663.991814:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564310528 00000100:00100000:2.0:1789672663.991855:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789672663.991863:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564310528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672663.991927:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564310528:12345-0@lo:400:kworker.0 Request processed in 66us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672663.991935:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789672663.992461:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564310912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672663.992502:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672663.992555:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564310912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1625us total) trans 0 rc 0/0 00000100:00080000:2.0:1789672663.992636:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672663.992696:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564310400:0@lo:400:kworker.0 00000100:00100000:2.0:1789672663.992728:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564310912:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789672663.992744:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa502bba300 x1876607564310528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672663.992755:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564310528:0@lo:400:kworker.0 00000100:00100000:0.0:1789672663.997238:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1789672664.309324:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789672665.123051:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000020:00000080:0.0:1789672665.123068:0:7637:0:(genops.c:885:class_export_put()) final put ffff9fa63adc7800/7225c799-181e-4570-897c-b66842e45960 00000020:00000080:2.0:1789672665.123125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63adc7800/7225c799-181e-4570-897c-b66842e45960 for lustre-OST0001 00000020:00000080:3.0:1789672665.124346:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa63adc4800 for lustre-OST0001 00010000:00010000:3.0:1789672665.332503:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672665.776014:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672665.776072:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672665.776108:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672665.776161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304704 00000100:00100000:2.0:1789672665.776253:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304576 00000100:00100000:2.0:1789672665.776263:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304576 00000100:00100000:2.0:1789672665.776365:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 119 00000100:00100000:2.0:1789672665.776379:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543304576:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672665.776484:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543304576:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672665.776493:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 119 00000100:00080000:2.0:1789672665.776521:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672665.776559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304448 00000100:00100000:0.0:1789672665.776566:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304448 00000100:00100000:0.0:1789672665.776612:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 279 00000100:00100000:0.0:1789672665.776620:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543304448:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672665.776650:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610364050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543304448:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 32us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672665.776656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 279 00000100:00100000:1.0:1789672665.776757:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304704 00000100:00100000:1.0:1789672665.776835:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:1.0:1789672665.776842:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543304704:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672665.776891:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543304704:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 49us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672665.776898:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00080000:1.0:1789672665.776930:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672666.355255:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672667.075151:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672667.075187:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564311040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672667.075333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672667.078903:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311040 00000100:00100000:0.0:1789672667.078928:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311040 00000100:00100000:0.0:1789672667.079061:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789672667.079079:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564311040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672667.079147:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672667.079332:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564311040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672667.079340:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789672667.079413:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570ce00 x1876607564311040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672667.079455:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564311040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789672667.081317:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789672667.381402:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672668.406962:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672668.659441:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789672669.107261:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672669.107370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672669.107769:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311168 00000100:00100000:0.0:1789672669.107780:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311168 00000100:00100000:0.0:1789672669.107877:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789672669.107891:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564311168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672669.107950:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672669.108010:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564311168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672669.108018:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789672669.108086:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672669.108185:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672669.108427:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564311552:0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.108475:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672669.108502:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672669.108508:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564311424:0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.108530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672669.108562:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311552 00000100:00100000:2.0:1789672669.108566:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311552 00000100:00100000:2.0:1789672669.108609:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311424 00000100:00100000:2.0:1789672669.108612:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311424 00000100:00100000:2.0:1789672669.108635:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789672669.108642:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564311552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.108685:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564311552:12345-0@lo:400:kworker.0 Request processed in 43us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672669.108692:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789672669.108711:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789672669.108717:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564311424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.108745:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564311424:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672669.108751:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789672669.108782:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672669.108848:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564311424:0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.108859:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564311552:0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.108953:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564311296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.108996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672669.109037:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564311808:0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.109070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672669.109090:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672669.109096:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564311680:0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.109124:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672669.109168:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311680 00000100:00100000:1.0:1789672669.109173:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311680 00000100:00100000:1.0:1789672669.109217:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789672669.109224:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564311680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.109264:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564311680:12345-0@lo:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672669.109269:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789672669.109291:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672669.109298:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311808 00000100:00100000:1.0:1789672669.109301:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311808 00000100:00100000:1.0:1789672669.109329:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789672669.109336:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564311808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.109365:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564311808:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672669.109372:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789672669.109387:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789672669.109407:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa641bda300 x1876607564311680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672669.109427:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564311680:0@lo:400:kworker.0 00000100:00100000:1.0:1789672669.109440:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564311808:0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.109637:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311296 00000100:00100000:2.0:1789672669.109641:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311296 00000100:00100000:2.0:1789672669.109679:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789672669.109686:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564311296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672669.109772:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610367050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564311296:12345-0@lo:400:kworker.0 Request processed in 86us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672669.109779:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789672669.111990:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564311296:0@lo:400:kworker.0 00010000:00010000:3.0:1789672669.427167:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672670.451117:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672670.474505:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:17:49 (1789672669) 00000100:00100000:1.0:1789672670.896643:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672670.896750:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672670.896817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672670.896851:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543305088 00000100:00100000:1.0:1789672670.896865:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543305088 00000100:00100000:1.0:1789672670.896961:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304960 00000100:00100000:1.0:1789672670.896965:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304960 00000100:00100000:1.0:1789672670.896995:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 124 00000100:00100000:1.0:1789672670.897007:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543305088:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672670.897102:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543305088:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672670.897110:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 124 00000100:00100000:1.0:1789672670.897131:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 125 00000100:00100000:1.0:1789672670.897138:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543304960:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672670.897169:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543304960:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 32us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672670.897175:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 125 00000100:00080000:1.0:1789672670.897192:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672670.897282:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543304832 00000100:00100000:2.0:1789672670.897287:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543304832 00000100:00100000:2.0:1789672670.897332:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 281 00000100:00100000:2.0:1789672670.897339:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543304832:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672670.897367:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610366450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543304832:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672670.897374:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 281 00010000:00010000:3.0:1789672671.475103:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672672.182152:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564311936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672672.182343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672672.182702:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564311936 00000100:00100000:0.0:1789672672.182725:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564311936 00000100:00100000:0.0:1789672672.182877:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789672672.182891:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564311936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672672.182964:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672672.183030:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564311936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672672.183038:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789672672.183627:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672672.183688:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa63570ce00 x1876607564311936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672672.183733:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564311936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672672.505147:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672672.505415:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672672.506387:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543305216 00000100:00100000:3.0:1789672672.506404:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543305216 00000100:00100000:3.0:1789672672.506580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:3.0:1789672672.506595:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+5:10221:x1876607543305216:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672672.506630:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672672.506660:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672672.506747:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672672.506762:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672672.506778:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672672.506868:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789672672.506891:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672672.506957:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672672.506991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7e5 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672672.507013:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7e5 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672672.507021:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:3.0:1789672672.507024:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672672.507028:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c400, rc 0) 00000100:00100000:3.0:1789672672.507104:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+6:10221:x1876607543305216:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 513us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672672.507111:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00080000:1.0:1789672672.508868:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672672.524890:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672672.527531:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543305344 00000100:00100000:1.0:1789672672.527555:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543305344 00000100:00100000:1.0:1789672672.527666:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:1.0:1789672672.527683:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+6:10222:x1876607543305344:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672672.527710:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672672.527735:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08a8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.527843:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.527858:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.527868:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.527879:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.527884:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.527888:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528483:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fc00/0x2247cb9491d08aa1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528505:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fc00/0x2247cb9491d08aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528515:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fc00/0x2247cb9491d08aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672672.528554:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789672672.528560:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672672.528589:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fc00/0x2247cb9491d08aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528602:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528609:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528616:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528622:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672672.528626:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528634:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528647:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:1.0:1789672672.528651:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672672.528657:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528672:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528688:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528694:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528699:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528704:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672672.528708:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528713:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528721:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fa6184b6700) 00010000:00010000:1.0:1789672672.528723:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672672.528726:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528731:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08a9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528771:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08a8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7ec expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528856:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fc00/0x2247cb9491d08aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7ec expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.528872:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa6184b6800) 00010000:00010000:1.0:1789672672.528874:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672672.528876:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fc00, rc 0) 00000100:00100000:1.0:1789672672.528991:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+7:10222:x1876607543305344:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1308us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672672.529000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:3.0:1789672672.537597:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672672.538836:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543305600 00000100:00100000:1.0:1789672672.538853:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543305600 00000100:00100000:1.0:1789672672.538943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:1.0:1789672672.538956:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+7:10222:x1876607543305600:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672672.538995:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672672.539034:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08aa8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.539134:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.539155:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.539171:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.542400:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.542501:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.542532:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544022:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f400/0x2247cb9491d08abd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544040:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f400/0x2247cb9491d08abd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544051:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f400/0x2247cb9491d08abd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672672.544063:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789672672.544577:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544586:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544593:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544611:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672672.544615:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544631:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544645:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa6184b6800) 00010000:00010000:1.0:1789672672.544648:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672672.544663:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544671:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08aaf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544685:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544691:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544696:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544700:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672672.544703:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544708:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544716:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa6184b6700) 00010000:00010000:1.0:1789672672.544718:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672672.544720:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.544726:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08ab6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.545354:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08aa8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7f3 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.545385:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f400/0x2247cb9491d08abd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7f3 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672672.545393:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:1.0:1789672672.545395:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672672.545398:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f400, rc 0) 00000100:00100000:1.0:1789672672.545534:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+9:10222:x1876607543305600:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 6579us (7951us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789672672.545544:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:3.0:1789672672.556223:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672672.556684:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543305728 00000100:00100000:1.0:1789672672.556698:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543305728 00000100:00100000:1.0:1789672672.556782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:1.0:1789672672.556987:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+9:10222:x1876607543305728:12345-192.168.202.39@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789672672.557309:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+9:10222:x1876607543305728:12345-192.168.202.39@tcp:59:lhsmtool_posix.0 Request processed in 325us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672672.557318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00000040:00080000:2.0:1789672672.759563:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789672673.523068:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672674.227163:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564312192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672674.227281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672674.227348:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564312704:0@lo:400:kworker.0 00000100:00100000:0.0:1789672674.227378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672674.227426:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672674.227432:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564312320:0@lo:400:kworker.0 00000100:00100000:0.0:1789672674.227457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672674.227534:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564312448:0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.227569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672674.227610:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789672674.227617:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564312064:0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.227650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672674.227682:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564312576:0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.227706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672674.227738:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312192 00000100:00100000:1.0:1789672674.227755:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312192 00000100:00100000:1.0:1789672674.227845:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312320 00000100:00100000:1.0:1789672674.227849:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312320 00000100:00100000:1.0:1789672674.227887:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312576 00000100:00100000:1.0:1789672674.227891:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312576 00000100:00100000:1.0:1789672674.227914:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789672674.227924:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564312192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.227997:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564312192:12345-0@lo:400:kworker.0 Request processed in 74us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672674.228005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789672674.228028:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789672674.228035:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564312320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.228066:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564312320:12345-0@lo:400:kworker.0 Request processed in 31us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672674.228072:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789672674.228084:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789672674.228090:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564312576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.228121:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564312576:12345-0@lo:400:kworker.0 Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672674.228132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789672674.228155:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312064 00000100:00100000:1.0:1789672674.228159:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312064 00000100:00100000:1.0:1789672674.228184:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789672674.228192:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564312064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.228222:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564312064:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672674.228228:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1789672674.228274:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672674.228305:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564312064:0@lo:400:kworker.0 00000100:00100000:1.0:1789672674.228319:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564312576:0@lo:400:kworker.0 00000100:00100000:2.0:1789672674.228814:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312704 00000100:00100000:2.0:1789672674.228822:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312704 00000100:00100000:2.0:1789672674.228883:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312448 00000100:00100000:2.0:1789672674.228888:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312448 00000100:00100000:2.0:1789672674.228915:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672674.228922:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564312704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672674.228978:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564312704:12345-0@lo:400:kworker.0 Request processed in 58us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672674.228994:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672674.229008:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789672674.229014:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564312448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672674.229052:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564312448:12345-0@lo:400:kworker.0 Request processed in 38us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672674.229058:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1789672674.229105:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa604a0fb80 x1876607564312448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672674.229119:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564312448:0@lo:400:kworker.0 00000100:00100000:0.0:1789672674.229562:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564312320:0@lo:400:kworker.0 00000100:00100000:0.0:1789672674.229577:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564312192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672674.229587:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564312704:0@lo:400:kworker.0 00000100:00080000:1.0:1789672674.230339:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672674.230346:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672674.233456:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564312832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672674.233564:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672674.233683:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564312832 00000100:00100000:2.0:1789672674.233695:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564312832 00000100:00100000:2.0:1789672674.233768:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672674.233780:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564312832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672674.233861:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672674.233930:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564312832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672674.233937:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672674.233997:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564312832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789672674.558029:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672674.964989:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672674.965046:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543305856 00000100:00100000:1.0:1789672674.965060:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543305856 00000100:00080000:2.0:1789672674.965209:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672674.965263:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:1.0:1789672674.965276:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+9:10264:x1876607543305856:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672674.965305:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672674.965338:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf7fa expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965428:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965448:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965462:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965481:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965488:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965508:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965829:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965838:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965845:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965852:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672674.965857:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965867:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965893:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:1.0:1789672674.965896:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672674.965901:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965908:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08ad2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965920:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965926:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965932:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965945:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672674.965948:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965954:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965963:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa6184b6100) 00010000:00010000:1.0:1789672674.965965:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672674.965968:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.965974:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08ad9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.966018:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08acb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7fa expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.966029:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:1.0:1789672674.966032:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672674.966035:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7fa expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.966044:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542ec00, rc 0) 00000100:00100000:1.0:1789672674.966129:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+9:10264:x1876607543305856:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 855us (1152us total) trans 0 rc 301/301 00000100:00100000:1.0:1789672674.966138:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:3.0:1789672674.974637:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672674.974899:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543306112 00000100:00100000:2.0:1789672674.974914:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543306112 00000100:00100000:2.0:1789672674.975145:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:2.0:1789672674.975157:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+9:10264:x1876607543306112:12345-192.168.202.39@tcp:36:lfs.0 00010000:00010000:2.0:1789672674.975237:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672674.975290:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08a85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7e5 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672674.975308:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:2.0:1789672674.975323:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672674.975614:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672674.975631:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672674.975643:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672674.975665:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672674.975673:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672674.975679:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672674.977151:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789672674.977180:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.977190:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.977199:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.977206:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672674.977211:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.977221:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.977238:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa60bce6a00) 00010000:00010000:1.0:1789672674.977241:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672674.977247:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672674.977254:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08ae0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672674.977272:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0d23a56 reply state 000000006d493c53 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672674.977282:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672674.978301:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+10:10264:x1876607543306112:12345-192.168.202.39@tcp:36:lfs.0 Request processed in 3134us (3667us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789672674.978316:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 37 00010000:00010000:3.0:1789672674.987354:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672674.987381:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672674.987390:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672674.987422:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672674.987428:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672674.987438:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672674.987461:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa60bce6500) 00010000:00010000:3.0:1789672674.987465:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672674.987471:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672674.987478:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08ae7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672675.098747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.098836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543306240 00000100:00100000:1.0:1789672675.098850:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543306240 00000100:00100000:1.0:1789672675.098929:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:1.0:1789672675.098942:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+9:10272:x1876607543306240:12345-192.168.202.39@tcp:101:lctl.0 00010000:00010000:1.0:1789672675.098980:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672675.099012:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf801 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.099100:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08af5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.099119:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08af5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.099133:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08af5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672675.099181:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789672675.099186:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672675.099236:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08af5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.099269:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf801 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.099289:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08af5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf801 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.099298:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:1.0:1789672675.099302:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672675.099314:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e400, rc 0) 00000100:00100000:1.0:1789672675.100672:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+10:10272:x1876607543306240:12345-192.168.202.39@tcp:101:lctl.0 Request processed in 1727us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672675.100685:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:0.0:1789672675.158306:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.159412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543306368 00000100:00100000:2.0:1789672675.159433:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543306368 00000100:00100000:3.0:1789672675.159596:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:3.0:1789672675.159611:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+10:10278:x1876607543306368:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672675.159641:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672675.159675:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08afc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf808 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.159810:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.159831:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.159846:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.159902:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.159911:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.159919:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160063:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08b11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160073:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160080:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672675.160118:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789672675.160122:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672675.160180:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08b11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160194:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160202:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160209:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160239:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672675.160245:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160254:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160271:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672675.160274:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672675.160281:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160288:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160305:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160311:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160317:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160322:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672675.160324:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160330:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160358:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa611330e00) 00010000:00010000:3.0:1789672675.160360:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672675.160363:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160370:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160414:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08afc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf808 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160430:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08b11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf808 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.160438:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672675.160440:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789672675.160442:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67da00, rc 0) 00000100:00100000:3.0:1789672675.160542:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+11:10278:x1876607543306368:12345-192.168.202.39@tcp:101:bash.0 Request processed in 933us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672675.160552:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:1.0:1789672675.164301:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672675.164391:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543306624 00000100:00100000:3.0:1789672675.164405:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543306624 00000100:00100000:3.0:1789672675.164479:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:3.0:1789672675.164491:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+11:10278:x1876607543306624:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672675.164518:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672675.164544:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08b18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf80f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.164764:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.164819:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.164835:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.170779:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.170819:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.170834:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672675.172319:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789672675.172825:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172842:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172855:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172921:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172939:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172946:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172952:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672675.172957:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172964:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172977:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672675.172979:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672675.172985:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.172990:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08b1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672675.173005:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac16586f reply state 0000000096b75c36 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.173013:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789672675.173052:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08b18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.173066:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.174288:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672675.174295:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672675.174299:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910e00, rc 0) 00000100:00100000:0.0:1789672675.174382:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+14:10278:x1876607543306624:12345-192.168.202.39@tcp:101:bash.0 Request processed in 9890us (10093us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789672675.174391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:0.0:1789672675.180149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672675.180243:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543306752 00000100:00100000:3.0:1789672675.180262:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543306752 00010000:00010000:1.0:1789672675.180281:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.180296:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.180305:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.180311:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672675.180325:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.180335:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672675.180353:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00010000:00010000:1.0:1789672675.180357:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa610c05200) 00010000:00010000:1.0:1789672675.180364:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672675.180375:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1876607543306752:12345-192.168.202.39@tcp:8:bash.0 00010000:00010000:1.0:1789672675.180377:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.180396:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08b26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789672675.180433:0:6684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:3.0:1789672675.180479:0:6684:0:(genops.c:1384:class_connect()) connect: client 7225c799-181e-4570-897c-b66842e45960, cookie 0x2247cb9491d08b3b 00002000:00100000:3.0:1789672675.180495:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7225c799-181e-4570-897c-b66842e45960/ffff9fa641bb5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789672675.180527:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789672675.180911:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789672675.180961:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fa641bb6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672675.181056:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:2356:x1876607543306752:12345-192.168.202.39@tcp:8:bash.0 Request processed in 690us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672675.181066:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:3.0:1789672675.184124:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.184263:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543306880 00000100:00100000:2.0:1789672675.184278:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543306880 00000100:00100000:2.0:1789672675.184389:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:2.0:1789672675.184403:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:0:x1876607543306880:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672675.184430:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672675.184462:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf816 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672675.184520:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672675.184548:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1789672675.184553:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672675.184565:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 7 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.184591:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 7 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.184608:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f400, rc 0) 00000100:00100000:2.0:1789672675.184690:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:0:x1876607543306880:12345-192.168.202.39@tcp:101:bash.0 Request processed in 289us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672675.184697:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:3.0:1789672675.187551:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672675.187697:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543307008 00000100:00100000:0.0:1789672675.187710:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543307008 00000100:00100000:0.0:1789672675.187822:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:0.0:1789672675.187835:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:10278:x1876607543307008:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:0.0:1789672675.187860:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672675.187899:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf81d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.187945:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 8 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.187956:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672675.187961:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672675.187966:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.188009:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 8 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.188064:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 8 pid: 8063 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.188084:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876607564312960:192.168.202.39@tcp:104: 00000100:00080000:1.0:1789672675.188119:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672675.188226:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672675.195280:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.195438:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543307136 00000100:00100000:1.0:1789672675.195478:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543307136 00000100:00100000:0.0:1789672675.195503:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876607564312960:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672675.195542:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 9 pid: 8063 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.195555:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.195584:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910a00, rc 0) 00000100:00100000:1.0:1789672675.195627:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:1.0:1789672675.195641:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+9:2358:x1876607543307136:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672675.195659:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789672675.195680:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+9:10278:x1876607543307008:12345-192.168.202.39@tcp:101:bash.0 Request processed in 7842us (8141us total) trans 0 rc 0/0 00010000:00010000:1.0:1789672675.195689:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 9 pid: 8063 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.195699:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 22 00010000:00010000:1.0:1789672675.195721:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 9 pid: 8063 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.195748:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08b42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf816 expref: 9 pid: 8063 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.195844:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672675.195850:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672675.195859:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.195882:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.195928:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672675.195958:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f797b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1876607564313088:192.168.202.39@tcp:105: 00000100:00100000:1.0:1789672675.196058:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672675.199270:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f797b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1876607564313088:192.168.202.39@tcp:105: 00010000:00010000:0.0:1789672675.199308:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672675.199396:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543307136:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 3758us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672675.199410:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:1.0:1789672675.206589:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.206705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543307392 00000100:00100000:2.0:1789672675.206719:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543307392 00000100:00100000:2.0:1789672675.206821:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:2.0:1789672675.206834:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+13:10278:x1876607543307392:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:2.0:1789672675.207373:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+14:10278:x1876607543307392:12345-192.168.202.39@tcp:35:bash.0 Request processed in 539us (798us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789672675.207383:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:2.0:1789672675.301245:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672675.301434:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543307648 00000100:00100000:3.0:1789672675.301470:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543307648 00000100:00100000:3.0:1789672675.301602:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 41 00000100:00100000:3.0:1789672675.301617:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+14:10288:x1876607543307648:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672675.301654:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672675.301684:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf824 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672675.301886:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789672675.302233:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf824 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.302251:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672675.302255:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672675.302509:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf824 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.302529:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672675.302623:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+15:10288:x1876607543307648:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1009us (1394us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789672675.302634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 41 00000100:00100000:3.0:1789672675.310395:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.310444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543307904 00000100:00100000:1.0:1789672675.310460:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543307904 00000100:00100000:1.0:1789672675.310530:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:1.0:1789672675.310542:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+15:10288:x1876607543307904:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672675.313504:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+16:10288:x1876607543307904:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 2949us (3109us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789672675.313521:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000001:00080000:3.0:1789672675.338350:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000001:00080000:3.0:1789672675.338379:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000100:00100000:0.0:1789672675.375968:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.376362:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543308032 00000100:00100000:1.0:1789672675.376376:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543308032 00000100:00100000:1.0:1789672675.376513:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:1.0:1789672675.376526:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+12:10294:x1876607543308032:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672675.376560:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672675.376588:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf82b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.376679:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08b65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.376696:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.376715:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672675.377366:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789672675.377374:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672675.377403:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.377714:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf82b expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.377816:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf82b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.377827:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672675.377829:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672675.377834:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f000, rc 0) 00000100:00100000:1.0:1789672675.378214:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+13:10294:x1876607543308032:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1687us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672675.378224:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:3.0:1789672675.383307:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.386558:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543308288 00000100:00100000:2.0:1789672675.386582:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543308288 00000100:00100000:2.0:1789672675.386689:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:2.0:1789672675.386702:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+13:10294:x1876607543308288:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672675.386761:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672675.386840:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08b6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf832 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.387016:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.387034:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.387049:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672675.387065:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789672675.387255:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08b6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf832 expref: 16 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.387281:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf832 expref: 15 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.387292:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:2.0:1789672675.387296:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672675.387301:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ea00, rc 0) 00000100:00100000:2.0:1789672675.387385:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+15:10294:x1876607543308288:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 685us (4094us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789672675.387393:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:3.0:1789672675.396779:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672675.396946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.397208:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543308544 00000100:00100000:1.0:1789672675.397223:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543308544 00000100:00100000:1.0:1789672675.397303:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:1.0:1789672675.397316:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+15:10294:x1876607543308544:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672675.397349:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672675.397378:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08b81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf839 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.397512:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08b88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.397552:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.397567:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672675.397585:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789672675.397809:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08b81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf839 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.397834:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf839 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.397844:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:1.0:1789672675.398101:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789672675.398106:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672675.398193:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+17:10294:x1876607543308544:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 879us (1430us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789672675.398202:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:2.0:1789672675.398464:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543308672 00000100:00100000:2.0:1789672675.398473:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543308672 00000100:00100000:2.0:1789672675.398535:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:2.0:1789672675.398554:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+17:2357:x1876607543308672:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672675.398568:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672675.398588:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08b73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf832 expref: 17 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.398602:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:2.0:1789672675.398605:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672675.398636:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+16:2357:x1876607543308672:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 84us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672675.398644:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:3.0:1789672675.413087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.413267:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543308800 00000100:00100000:2.0:1789672675.413284:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543308800 00000100:00100000:2.0:1789672675.413377:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:2.0:1789672675.413392:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543308800:12345-192.168.202.39@tcp:1:lfs.0 00010000:00010000:2.0:1789672675.413462:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.413489:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.413500:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789672675.413505:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672675.413511:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.413561:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.413599:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 7 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672675.413619:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876607564313216:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672675.413748:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa609256000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672675.419331:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876607564313216:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672675.419377:0:8063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.421632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672675.422162:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543308928 00000100:00100000:3.0:1789672675.422198:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543308928 00002000:00100000:3.0:1789672675.422272:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fa604a0e680 x1876607543308928/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:301/0 lens 504/0 e 0 to 0 dl 1789672686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672675.422284:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa604a0e680 with x1876607543308928 ext(0->12) 00010000:00010000:3.0:1789672675.422296:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 8 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.422318:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 8 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672675.422327:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa604a0e680 00000100:00100000:3.0:1789672675.422366:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:3.0:1789672675.422377:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543308928:12345-192.168.202.39@tcp:4:lfs.0 00000001:00100000:0.0:1789672675.493968:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000100:00100000:2.0:1789672675.494720:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+9:2358:x1876607543308928:12345-192.168.202.39@tcp:4:lfs.0 Request processed in 72332us (73089us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789672675.494742:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00002000:00100000:2.0:1789672675.494759:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fa604a0e680 x1876607543308928/t4294967299(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:301/0 lens 504/448 e 0 to 0 dl 1789672686 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672675.494769:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa604a0e680 with x1876607543308928 ext(0->12) 00010000:00010000:2.0:1789672675.494782:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.494831:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672675.494841:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa604a0e680 00000100:00100000:3.0:1789672675.499918:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.500040:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543309056 00000100:00100000:2.0:1789672675.500066:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543309056 00010000:00010000:2.0:1789672675.500122:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672675.500181:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:2.0:1789672675.500191:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+9:2357:x1876607543309056:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672675.500206:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789672675.500225:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789672675.500228:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789672675 00002000:00010000:2.0:1789672675.500231:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789672676 00002000:00010000:2.0:1789672675.500234:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789672675 00010000:00010000:2.0:1789672675.500240:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.500255:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.500281:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d648f17f/0x2247cb9491d08b49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf81d expref: 9 pid: 6685 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.500655:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672675.500659:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672675.500666:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.500676:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.500859:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672675.500989:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543309056:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 791us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672675.501001:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 36 00010000:00010000:2.0:1789672675.506343:0:8063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506366:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506408:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506418:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506427:0:8063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506435:0:8063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672675.506440:0:8063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506450:0:8063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506470:0:8063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.506503:0:8063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0221a81/0x2247cb9491d08b96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672675.506635:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543308800:12345-192.168.202.39@tcp:1:lfs.0 Request processed in 93242us (93557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672675.506646:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:3.0:1789672675.511690:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672675.512619:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543309312 00000100:00100000:0.0:1789672675.512635:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543309312 00000100:00100000:0.0:1789672675.512887:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:0.0:1789672675.512900:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+16:10294:x1876607543309312:12345-192.168.202.39@tcp:35:lfs.0 00000004:00010000:0.0:1789672675.513184:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf839 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672675.513672:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789672675.514154:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789672675.515703:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789672675.517365:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.517395:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.517406:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.517608:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.517630:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 20 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.517647:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876607564313344:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672675.518126:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672675.523904:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876607564313344:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672675.523941:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672675.524320:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.524396:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543309440 00000100:00100000:2.0:1789672675.524405:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543309440 00010000:00010000:2.0:1789672675.524445:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 21 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672675.524478:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:2.0:1789672675.524489:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+21:2358:x1876607543309440:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672675.524506:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672675.524513:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 21 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.524526:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 21 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.524548:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf80f expref: 21 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.524564:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:2.0:1789672675.524570:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.524588:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.524595:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.524627:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672675.524693:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+20:2358:x1876607543309440:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 206us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672675.524701:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 37 00010000:00010000:0.0:1789672675.524779:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.524831:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672675.524977:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789672675.525195:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789672675.525312:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564313472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789672675.525368:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672675.525393:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672675.525485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564313472 00000100:00100000:2.0:1789672675.525491:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564313472 00000100:00100000:2.0:1789672675.525525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672675.525532:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876607564313472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789672675.525622:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876607564313472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672675.525629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672675.525694:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564313472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789672675.526459:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789672675.526560:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564313600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789672675.526607:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672675.526633:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672675.526715:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564313600 00000100:00100000:2.0:1789672675.526721:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564313600 00000100:00100000:2.0:1789672675.526758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672675.526765:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876607564313600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789672675.527293:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1876607564313600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 519us (677us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789672675.527316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672675.527360:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564313600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789672675.527417:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1789672675.527457:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.527467:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.527475:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.527480:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672675.527494:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.527502:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.527516:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672675.527519:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789672675.527524:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.527530:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d08b9d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672675.527694:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789672675.528275:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789672675.528595:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344309808487ns, next at 345309804889ns, rc = 0 00000001:00080000:0.0:1789672675.528606:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789672675.528651:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672675.528655:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789672675.528664:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08b88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf839 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.528818:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+23:10294:x1876607543309312:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 15920us (17142us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789672675.528828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000020:00080000:0.0:1789672675.528834:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789672675.532412:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.533225:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543309568 00000100:00100000:2.0:1789672675.533240:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543309568 00000100:00100000:3.0:1789672675.533583:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:3.0:1789672675.533597:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+23:10294:x1876607543309568:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672675.533644:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672675.533676:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08ba4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf840 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.533762:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf840 expref: 24 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.533783:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf840 expref: 24 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.533828:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672675.533831:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672675.533836:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:3.0:1789672675.533952:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+24:10294:x1876607543309568:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 358us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672675.533960:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:2.0:1789672675.538536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.538717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543309824 00000100:00100000:1.0:1789672675.538731:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543309824 00000100:00100000:1.0:1789672675.538851:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:1.0:1789672675.538874:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+24:10294:x1876607543309824:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672675.539220:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+25:10294:x1876607543309824:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 357us (697us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789672675.539228:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00010000:00010000:3.0:1789672675.571326:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672675.641847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672675.642001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543310080 00000100:00100000:2.0:1789672675.642016:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543310080 00000100:00100000:2.0:1789672675.642102:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:2.0:1789672675.642115:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+25:10305:x1876607543310080:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672675.642155:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672675.642183:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf847 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672675.642311:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789672675.642652:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08bab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf847 expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.642669:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672675.642673:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672675.642679:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf847 expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672675.642696:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fa00, rc 0) 00000100:00100000:2.0:1789672675.642783:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+26:10305:x1876607543310080:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 670us (950us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789672675.642897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:3.0:1789672675.646489:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672675.646606:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543310208 00000100:00100000:0.0:1789672675.646622:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543310208 00000100:00100000:0.0:1789672675.646719:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:0.0:1789672675.646731:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:10305:x1876607543310208:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:0.0:1789672675.646908:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.646933:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.646950:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.646970:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.646979:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.646985:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647321:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647331:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647338:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672675.647394:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647410:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647428:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647436:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647443:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911e00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672675.647449:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647458:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647473:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672675.647477:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672675.647483:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647490:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08bb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647505:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647511:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647517:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647522:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672675.647532:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647539:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647547:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa610c05500) 00010000:00010000:0.0:1789672675.647549:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672675.647553:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647559:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08bc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647575:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647582:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647588:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647593:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672675.647597:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647602:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647609:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:0.0:1789672675.647611:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672675.647621:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672675.647627:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672675.647748:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:10305:x1876607543310208:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 1017us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672675.647759:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:0.0:1789672675.650877:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.650980:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543310464 00000100:00100000:1.0:1789672675.650995:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543310464 00000100:00100000:1.0:1789672675.651078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672675.651090:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+26:10305:x1876607543310464:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672675.651414:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+27:10305:x1876607543310464:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 327us (561us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789672675.651423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672675.684688:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672675.684954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543310720 00000100:00100000:3.0:1789672675.684968:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543310720 00000100:00100000:3.0:1789672675.685057:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:3.0:1789672675.685070:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+27:10308:x1876607543310720:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672675.685106:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672675.685134:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08bce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf84e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.685242:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.685281:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.685294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.685314:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.685320:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.685327:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686098:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686112:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686122:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672675.686136:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789672675.686263:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686273:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686281:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686297:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672675.686303:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686312:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686328:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672675.686332:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672675.686481:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686490:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08bd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686508:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686515:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686521:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686527:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672675.686530:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686537:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686558:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa611330400) 00010000:00010000:3.0:1789672675.686560:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672675.686564:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686571:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08bdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686636:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08bce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686652:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672675.686660:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672675.686663:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672675.686666:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c200, rc 0) 00000100:00100000:3.0:1789672675.686957:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+29:10308:x1876607543310720:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1887us (2283us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789672675.686969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:3.0:1789672675.689474:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.689601:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543310848 00000100:00100000:1.0:1789672675.689615:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543310848 00000100:00100000:1.0:1789672675.689690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:1.0:1789672675.689703:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+29:10308:x1876607543310848:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:1.0:1789672675.689926:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.689948:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.689962:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.689996:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.690004:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.690012:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.690157:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672675.690164:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.690174:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.690191:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672675.690194:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672675.690201:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672675.690208:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672675.690358:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+29:10308:x1876607543310848:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 656us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672675.690367:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:2.0:1789672675.700699:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672675.701301:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543311104 00000100:00100000:1.0:1789672675.701316:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543311104 00000100:00100000:1.0:1789672675.701474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:1.0:1789672675.701489:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+29:10308:x1876607543311104:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672675.702594:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+30:10308:x1876607543311104:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 1100us (1903us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789672675.702606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:2.0:1789672676.004597:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672676.004706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543311360 00000100:00100000:1.0:1789672676.004718:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543311360 00000100:00100000:1.0:1789672676.004831:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 50 00000100:00100000:1.0:1789672676.004857:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+30:10339:x1876607543311360:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:1.0:1789672676.004895:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672676.004928:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf855 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.005035:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.005063:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.005076:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672676.005089:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789672676.005236:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf855 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.005255:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf855 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.005264:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672676.005268:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672676.005272:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e200, rc 0) 00000100:00100000:1.0:1789672676.005335:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+32:10339:x1876607543311360:12345-192.168.202.39@tcp:101:cat.0 Request processed in 482us (750us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789672676.005344:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 50 00000100:00080000:2.0:1789672676.005447:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672676.015684:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.015731:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.015772:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.015821:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.015851:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.015892:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543312128 00000100:00100000:2.0:1789672676.015902:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543312128 00000100:00100000:2.0:1789672676.015976:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:2.0:1789672676.015987:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+32:2357:x1876607543312128:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672676.016003:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672676.016028:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf855 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.016047:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:2.0:1789672676.016052:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672676.016105:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+31:2357:x1876607543312128:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672676.016112:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:3.0:1789672676.016191:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543311872 00000100:00100000:3.0:1789672676.016196:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543311872 00000100:00100000:3.0:1789672676.016226:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:3.0:1789672676.016233:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543311872:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672676.016281:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543311872:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 48us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672676.016299:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:1.0:1789672676.016314:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543311744 00000100:00100000:1.0:1789672676.016318:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543311744 00000100:00100000:3.0:1789672676.016332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543311616 00000100:00100000:3.0:1789672676.016335:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543311616 00000100:00100000:1.0:1789672676.016353:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 283 00000100:00100000:1.0:1789672676.016359:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543311744:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672676.016369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:3.0:1789672676.016375:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+31:10339:x1876607543311616:12345-192.168.202.39@tcp:35:cat.0 00000100:00100000:1.0:1789672676.016386:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610365850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543311744:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 28us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672676.016392:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 283 00000100:00100000:0.0:1789672676.016575:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543312000 00000100:00100000:0.0:1789672676.016580:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543312000 00000100:00100000:0.0:1789672676.016628:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 129 00000100:00100000:0.0:1789672676.016635:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543312000:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672676.016663:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543312000:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672676.016670:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 129 00000100:00100000:3.0:1789672676.016679:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+32:10339:x1876607543311616:12345-192.168.202.39@tcp:35:cat.0 Request processed in 304us (858us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789672676.016686:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00080000:1.0:1789672676.016737:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672676.081599:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672676.081697:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543312384 00000100:00100000:1.0:1789672676.081707:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543312384 00000100:00100000:1.0:1789672676.081771:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:1.0:1789672676.081781:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+32:10345:x1876607543312384:12345-192.168.202.39@tcp:101:dd.0 00010000:00010000:1.0:1789672676.081855:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672676.081869:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789672676.081896:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08b65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf82b expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.081916:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672676.081921:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672676.081935:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08c0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf85c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.082037:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.082051:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.082061:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.082110:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.082123:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 32 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672676.082136:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f796a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564313728:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672676.082223:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767000 going to sleep for 11 seconds 00000100:00100000:1.0:1789672676.085482:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f796a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564313728:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672676.085512:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672676.089089:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672676.089306:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543312512 00000100:00100000:1.0:1789672676.089316:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543312512 00010000:00010000:1.0:1789672676.089363:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 33 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672676.089418:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:1.0:1789672676.089431:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+33:2358:x1876607543312512:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672676.089447:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672676.089455:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 33 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.089469:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 33 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.089512:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d08be3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf84e expref: 33 pid: 5832 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.089529:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672676.089534:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.089544:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.089551:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.089584:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672676.089647:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+32:2358:x1876607543312512:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 218us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672676.089654:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 38 00010000:00010000:2.0:1789672676.090059:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.090068:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672676.090091:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789672676.090270:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08c0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.090287:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.090295:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:2.0:1789672676.090297:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672676.090307:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f200, rc 0) 00000100:00100000:2.0:1789672676.090349:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+32:10345:x1876607543312384:12345-192.168.202.39@tcp:101:dd.0 Request processed in 8570us (8761us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789672676.090357:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:2.0:1789672676.096219:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672676.096293:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543312768 00000100:00100000:0.0:1789672676.096303:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543312768 00000100:00100000:0.0:1789672676.096372:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:0.0:1789672676.096383:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+32:10345:x1876607543312768:12345-192.168.202.39@tcp:36:dd.0 00010000:00010000:0.0:1789672676.096704:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.096722:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.096734:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672676.096849:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789672676.096886:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7e909c3 reply state 00000000631f2d51 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672676.096895:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672676.096982:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+35:10345:x1876607543312768:12345-192.168.202.39@tcp:36:dd.0 Request processed in 600us (772us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789672676.096990:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 52 00000020:00080000:0.0:1789672676.096994:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789672676.101966:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.101983:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.101990:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.101996:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672676.102001:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.102008:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.102022:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672676.102025:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672676.102030:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.102064:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d08c22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672676.428160:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672676.428295:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543312896 00000100:00100000:0.0:1789672676.428309:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543312896 00000100:00100000:0.0:1789672676.428441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:0.0:1789672676.428453:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+34:10359:x1876607543312896:12345-192.168.202.39@tcp:101:stat.0 00010000:00010000:0.0:1789672676.428491:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672676.428522:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf863 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.428686:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.428705:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.428848:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.428879:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.428909:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.428916:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.429424:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.429441:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.429451:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.429498:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.429517:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 35 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672676.429534:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564313856:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672676.429944:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672676.434369:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672676.434643:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543313152 00000100:00100000:1.0:1789672676.434657:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543313152 00000100:00100000:1.0:1789672676.434741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:1.0:1789672676.434752:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+36:5596:x1876607543313152:12345-192.168.202.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789672676.435274:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+37:5596:x1876607543313152:12345-192.168.202.39@tcp:35:ldlm_bl.0 Request processed in 522us (920us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789672676.435284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:0.0:1789672676.437060:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564313856:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672676.437234:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672676.437999:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.438129:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543313280 00000100:00100000:2.0:1789672676.438140:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543313280 00010000:00010000:2.0:1789672676.438192:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 37 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672676.438266:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:2.0:1789672676.438275:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+37:2358:x1876607543313280:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672676.438291:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672676.438297:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 37 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.438308:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 37 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.438337:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08c14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf85c expref: 37 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.438355:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:2.0:1789672676.438359:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.438368:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.438395:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.438434:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672676.438504:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+36:2358:x1876607543313280:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 228us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672676.438512:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00010000:00010000:0.0:1789672676.439079:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439100:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672676.439163:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789672676.439168:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672676.439218:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439235:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439246:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439253:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439260:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439267:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672676.439272:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439281:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439293:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672676.439297:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672676.439301:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439317:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d08c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439344:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439351:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439357:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439362:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672676.439365:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439372:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439380:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa610c05500) 00010000:00010000:0.0:1789672676.439383:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672676.439386:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439393:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439445:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf863 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439463:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf863 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.439477:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:0.0:1789672676.439480:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672676.439482:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911800, rc 0) 00000100:00100000:0.0:1789672676.440013:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+35:10359:x1876607543312896:12345-192.168.202.39@tcp:101:stat.0 Request processed in 11100us (11406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672676.440024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:1.0:1789672676.495410:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672676.496216:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543313536 00000100:00100000:0.0:1789672676.496233:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543313536 00000100:00100000:0.0:1789672676.496317:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 54 00000100:00100000:0.0:1789672676.496487:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+35:10365:x1876607543313536:12345-192.168.202.39@tcp:36:truncate.0 00010000:00010000:0.0:1789672676.496635:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672676.496671:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf863 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.496949:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:0.0:1789672676.496957:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672676.499307:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.499446:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.499463:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672676.499539:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789672676.499635:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b18b750d reply state 0000000056f8a68d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672676.499666:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672676.500181:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+37:10365:x1876607543313536:12345-192.168.202.39@tcp:36:truncate.0 Request processed in 3845us (4776us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789672676.500192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 54 00000020:00080000:0.0:1789672676.500199:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789672676.515297:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.515638:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.515647:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.515653:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911e00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672676.515659:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.515668:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.516134:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672676.516139:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672676.516147:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.516155:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d08c45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.599829:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672676.662652:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.663725:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543313664 00000100:00100000:2.0:1789672676.663746:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543313664 00000100:00100000:2.0:1789672676.663905:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672676.663919:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+36:10379:x1876607543313664:12345-192.168.202.39@tcp:101:stat.0 00010000:00010000:2.0:1789672676.663953:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672676.663982:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08c4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf86a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664077:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664096:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664111:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664129:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664137:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664168:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664506:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664515:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664523:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672676.664917:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789672676.664925:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672676.664960:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664975:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664984:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664990:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.664998:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665004:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ea00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672676.665009:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665028:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665044:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672676.665047:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672676.665054:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665061:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665075:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665081:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665086:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665091:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672676.665094:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665101:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665108:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa602b49100) 00010000:00010000:2.0:1789672676.665111:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672676.665114:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665130:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665174:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08c4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665191:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.665199:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:2.0:1789672676.665202:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672676.665205:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f400, rc 0) 00000100:00100000:2.0:1789672676.665308:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+37:10379:x1876607543313664:12345-192.168.202.39@tcp:101:stat.0 Request processed in 1391us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672676.665318:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672676.754139:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672676.755012:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543313920 00000100:00100000:3.0:1789672676.755039:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543313920 00000100:00100000:3.0:1789672676.755182:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 56 00000100:00100000:3.0:1789672676.755197:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+37:10389:x1876607543313920:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672676.755228:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672676.755258:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08c68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf871 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672676.755394:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789672676.755573:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08c68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf871 expref: 39 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.755587:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672676.755590:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672676.755594:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf871 expref: 39 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.755608:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672676.755683:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+38:10389:x1876607543313920:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 490us (1562us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789672676.755691:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 56 00000100:00100000:1.0:1789672676.765511:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672676.765649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543314176 00000100:00100000:3.0:1789672676.765664:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543314176 00000100:00100000:3.0:1789672676.765760:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:3.0:1789672676.765783:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+38:10389:x1876607543314176:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:3.0:1789672676.766172:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+39:10389:x1876607543314176:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 401us (679us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789672676.766181:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:1.0:1789672676.866734:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672676.868406:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543314432 00000100:00100000:0.0:1789672676.868424:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543314432 00000100:00100000:0.0:1789672676.868507:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:0.0:1789672676.868520:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+39:10395:x1876607543314432:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:0.0:1789672676.868572:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672676.868597:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf878 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.868715:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.868734:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.868744:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.868810:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.868828:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 40 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672676.868876:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564313984:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672676.869698:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672676.875581:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564313984:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672676.875630:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672676.877212:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.877662:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543314560 00000100:00100000:2.0:1789672676.877676:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543314560 00010000:00010000:2.0:1789672676.877747:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 41 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672676.877832:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:3.0:1789672676.877848:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+41:2358:x1876607543314560:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672676.877910:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672676.877920:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 41 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.877936:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 41 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.877964:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08c61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf86a expref: 41 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.877984:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672676.877991:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.878002:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.878011:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.878067:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672676.878117:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.878127:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672676.878152:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+40:2358:x1876607543314560:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 310us (951us total) trans 0 rc 0/0 00000004:00200000:0.0:1789672676.878156:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:3.0:1789672676.878160:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 40 00010000:00010000:0.0:1789672676.878356:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.878375:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.878384:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:0.0:1789672676.878386:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672676.878389:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911a00, rc 0) 00000100:00100000:0.0:1789672676.878415:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+40:10395:x1876607543314432:12345-192.168.202.39@tcp:101:bash.0 Request processed in 9898us (11699us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789672676.878422:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:2.0:1789672676.883341:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672676.883394:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543314816 00000100:00100000:0.0:1789672676.883429:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543314816 00000100:00100000:0.0:1789672676.883508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 58 00000100:00100000:0.0:1789672676.883521:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+40:10395:x1876607543314816:12345-192.168.202.39@tcp:36:bash.0 00010000:00010000:0.0:1789672676.884236:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.884261:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672676.884275:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672676.884354:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1789672676.884382:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c992571 reply state 000000007b4dd703 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672676.884393:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672676.885256:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+43:10395:x1876607543314816:12345-192.168.202.39@tcp:36:bash.0 Request processed in 1729us (1932us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789672676.885268:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 58 00000020:00080000:0.0:1789672676.885277:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789672676.893347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.893444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543314944 00000100:00100000:2.0:1789672676.893457:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543314944 00000100:00100000:2.0:1789672676.893524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:2.0:1789672676.893535:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+43:10395:x1876607543314944:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672676.893578:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672676.893617:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf87f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893734:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893752:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893762:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893769:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893815:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893847:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672676.893872:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672676.893889:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641bdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564314112:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672676.893999:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610c46000 going to sleep for 11 seconds 00010000:00010000:3.0:1789672676.894476:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894488:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894496:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894502:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672676.894506:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894515:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894532:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672676.894536:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672676.894539:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894549:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.894614:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d08c8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672676.899676:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672676.900098:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641bdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564314112:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672676.900139:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672676.900356:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543315072 00000100:00100000:3.0:1789672676.900366:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543315072 00010000:00010000:3.0:1789672676.900422:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672676.900509:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 41 00000100:00100000:3.0:1789672676.900520:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+44:2358:x1876607543315072:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672676.900541:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672676.900550:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.900572:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.900598:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d08c7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf878 expref: 44 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.900616:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672676.900621:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.900634:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.900643:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.900679:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672676.900756:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+43:2358:x1876607543315072:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 237us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672676.900764:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 41 00010000:00010000:1.0:1789672676.901105:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.901126:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672676.901192:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789672676.901198:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672676.901234:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.901273:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08c92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf87f expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.901291:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf87f expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672676.901299:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672676.901301:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672676.901304:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ea00, rc 0) 00000100:00100000:1.0:1789672676.901353:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+42:10395:x1876607543314944:12345-192.168.202.39@tcp:101:bash.0 Request processed in 7820us (8028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672676.901361:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:1.0:1789672676.907359:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672676.907644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543315328 00000100:00100000:3.0:1789672676.907659:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543315328 00000100:00100000:3.0:1789672676.907779:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:3.0:1789672676.907825:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+42:10395:x1876607543315328:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:3.0:1789672676.908320:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+43:10395:x1876607543315328:12345-192.168.202.39@tcp:35:bash.0 Request processed in 497us (975us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789672676.908394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:0.0:1789672676.983166:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672676.983253:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543315584 00000100:00100000:3.0:1789672676.983265:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543315584 00000100:00100000:3.0:1789672676.983333:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:3.0:1789672676.983343:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+43:10405:x1876607543315584:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672676.983372:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672676.983396:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf886 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672676.983498:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789672676.983661:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08ca0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf886 expref: 45 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.983678:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672676.983682:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672676.983688:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf886 expref: 45 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.983707:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672676.983847:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+44:10405:x1876607543315584:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 445us (633us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789672676.983888:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:0.0:1789672676.985969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672676.986111:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543315712 00000100:00100000:3.0:1789672676.986122:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543315712 00000100:00100000:3.0:1789672676.986233:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:3.0:1789672676.986245:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+44:10405:x1876607543315712:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:3.0:1789672676.986346:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986366:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986383:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986397:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986402:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986407:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986703:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986710:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986718:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672676.986780:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986838:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986846:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986863:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986869:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672676.986875:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986883:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986895:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672676.986898:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672676.986904:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986910:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986924:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986930:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986942:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986947:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672676.986950:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986956:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986962:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa611330400) 00010000:00010000:3.0:1789672676.986964:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672676.986966:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986972:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986986:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986993:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.986998:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.987003:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672676.987006:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.987026:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.987045:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672676.987047:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672676.987051:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672676.987056:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672676.987144:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+44:10405:x1876607543315712:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 899us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672676.987153:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:1.0:1789672676.989079:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672676.989168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543315968 00000100:00100000:3.0:1789672676.989179:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543315968 00000100:00100000:3.0:1789672676.989299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:3.0:1789672676.989308:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+44:10405:x1876607543315968:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:3.0:1789672676.989625:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+45:10405:x1876607543315968:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 318us (556us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789672676.989630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:0.0:1789672677.054094:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672677.054256:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543316224 00000100:00100000:3.0:1789672677.054271:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543316224 00000100:00100000:3.0:1789672677.054352:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00100000:3.0:1789672677.054366:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+45:10408:x1876607543316224:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672677.054401:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672677.054430:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf88d expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.054657:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.054674:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.054687:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.054704:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.054711:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.054717:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057142:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08cd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057165:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057178:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672677.057196:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789672677.057336:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057345:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057367:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057374:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672677.057379:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057388:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057402:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672677.057406:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672677.057412:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057418:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08cca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057435:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057442:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057448:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057454:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672677.057457:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057474:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057493:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa611330400) 00010000:00010000:3.0:1789672677.057503:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672677.057507:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.057513:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.058313:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08cc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf88d expref: 48 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.058338:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf88d expref: 47 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.058346:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:3.0:1789672677.058348:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672677.058351:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672677.058453:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+47:10408:x1876607543316224:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 4089us (4374us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789672677.058464:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00100000:0.0:1789672677.062425:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.063122:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543316352 00000100:00100000:1.0:1789672677.063137:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543316352 00000100:00100000:1.0:1789672677.063217:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:1.0:1789672677.063230:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+47:10408:x1876607543316352:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:1.0:1789672677.063318:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063371:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063386:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063549:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063558:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063565:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063572:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672677.063577:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063585:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063600:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672677.063604:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672677.063610:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.063617:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ce6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672677.063717:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+47:10408:x1876607543316352:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 488us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672677.063732:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:1.0:1789672677.066523:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672677.067164:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543316608 00000100:00100000:3.0:1789672677.067182:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543316608 00000100:00100000:3.0:1789672677.067289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:3.0:1789672677.067301:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+47:10408:x1876607543316608:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:3.0:1789672677.067813:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+48:10408:x1876607543316608:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 487us (1274us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789672677.067823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:0.0:1789672677.077125:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672677.077489:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543316736 00000100:00100000:2.0:1789672677.077513:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543316736 00000100:00100000:2.0:1789672677.077605:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:2.0:1789672677.077618:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+48:2360:x1876607543316736:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672677.077639:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672677.077671:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d08cd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf88d expref: 48 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.077697:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:2.0:1789672677.077704:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672677.077808:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+47:2360:x1876607543316736:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 192us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672677.077817:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:0.0:1789672677.251722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.251915:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543316992 00000100:00100000:1.0:1789672677.251930:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543316992 00000100:00100000:1.0:1789672677.252013:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:1.0:1789672677.252036:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+47:10426:x1876607543316992:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:1.0:1789672677.252069:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672677.252099:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ced lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf894 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.252237:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08cf4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.252255:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.252270:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672677.252283:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789672677.252452:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08ced lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf894 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.252476:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf894 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.252485:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:1.0:1789672677.252489:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789672677.252515:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e200, rc 0) 00000100:00100000:1.0:1789672677.252597:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+49:10426:x1876607543316992:12345-192.168.202.39@tcp:101:cat.0 Request processed in 574us (888us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789672677.252606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 64 00000004:00080000:0.0:1789672677.299228:0:6835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346080438930ns, next at 347080435689ns, rc = 0 00000100:00100000:3.0:1789672677.299337:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672677.299365:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564314240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672677.299469:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672677.301611:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564314240 00000100:00100000:0.0:1789672677.301632:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564314240 00000100:00100000:0.0:1789672677.301748:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789672677.301762:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564314240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672677.301841:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672677.301973:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564314240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672677.301982:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789672677.308643:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672677.309660:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564314240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672677.310162:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672677.316290:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543317120 00000100:00100000:3.0:1789672677.316310:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543317120 00000100:00100000:2.0:1789672677.317768:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:2.0:1789672677.317959:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+49:10427:x1876607543317120:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672677.317996:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672677.318036:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf89b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.318131:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08d09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.318150:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.318166:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672677.318238:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789672677.318242:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672677.318263:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.318294:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf89b expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.318312:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf89b expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.318319:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672677.318322:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672677.318325:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f200, rc 0) 00000100:00100000:2.0:1789672677.318413:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+50:10427:x1876607543317120:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 633us (8254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672677.318421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:0.0:1789672677.328685:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.328856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543317504 00000100:00100000:1.0:1789672677.328881:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543317504 00000100:00100000:1.0:1789672677.328956:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:1.0:1789672677.328968:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+50:10427:x1876607543317504:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672677.329560:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+51:10427:x1876607543317504:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 591us (888us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789672677.329569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:0.0:1789672677.332479:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672677.332576:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543317632 00000100:00100000:2.0:1789672677.332589:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543317632 00000100:00100000:2.0:1789672677.332674:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:2.0:1789672677.332686:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+51:10427:x1876607543317632:12345-192.168.202.39@tcp:103:lfs.0 00010000:00010000:2.0:1789672677.332706:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789672677.332737:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf87f expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.332780:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf894 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.332886:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d08ba4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf840 expref: 49 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.332898:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa611330e00) 00010000:00010000:2.0:1789672677.332911:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672677.332988:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+48:10427:x1876607543317632:12345-192.168.202.39@tcp:103:lfs.0 Request processed in 304us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672677.332996:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:2.0:1789672677.336152:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.336579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543317760 00000100:00100000:1.0:1789672677.336594:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543317760 00000100:00100000:1.0:1789672677.336667:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:1.0:1789672677.336680:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+48:10427:x1876607543317760:12345-192.168.202.39@tcp:58:lfs.0 00010000:00010000:1.0:1789672677.336886:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.336906:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.336921:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672677.337297:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789672677.338116:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789672677.338197:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789672677.338350:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+48:10427:x1876607543317760:12345-192.168.202.39@tcp:58:lfs.0 Request processed in 1669us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672677.338362:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:1.0:1789672677.373764:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672677.374053:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543317888 00000100:00100000:2.0:1789672677.374067:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543317888 00000100:00100000:2.0:1789672677.374146:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 67 00000100:00100000:2.0:1789672677.374158:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+48:10429:x1876607543317888:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672677.374186:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672677.374219:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08d17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8a2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374305:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374324:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374337:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374354:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374379:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374385:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374718:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374728:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374735:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672677.374816:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789672677.374822:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672677.374857:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374872:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374882:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374889:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374896:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374913:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672677.374919:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374927:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374940:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672677.374944:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672677.374950:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374957:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08d1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374970:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374976:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374981:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374987:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672677.374990:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.374996:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.375016:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa602b49100) 00010000:00010000:2.0:1789672677.375019:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672677.375023:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.375030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.375071:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d08d17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.375088:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.375096:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:2.0:1789672677.375099:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672677.375101:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f400, rc 0) 00000100:00100000:2.0:1789672677.375206:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+49:10429:x1876607543317888:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1048us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672677.375216:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 67 00010000:00010000:2.0:1789672677.619156:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672677.879324:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672677.879334:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672677.879406:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789672677.879413:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672677.879543:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564314368:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789672677.879662:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610e1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789672677.888619:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564314368:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672677.899224:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.900180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543318016 00000100:00100000:1.0:1789672677.900191:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543318016 00000100:00100000:1.0:1789672677.900246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:1.0:1789672677.900256:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318016:12345-192.168.202.39@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789672677.900348:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318016:12345-192.168.202.39@tcp:900:lhsmtool_posix.0 Request processed in 93us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672677.900357:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:0.0:1789672677.911007:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.912014:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543318144 00000100:00100000:1.0:1789672677.912030:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543318144 00000100:00100000:1.0:1789672677.912092:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 68 00000100:00100000:1.0:1789672677.912101:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318144:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789672677.912133:0:7918:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789672677.912417:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318144:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 315us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672677.912425:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 68 00000100:00100000:3.0:1789672677.922960:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672677.926160:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543318272 00000100:00100000:3.0:1789672677.926174:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543318272 00000100:00100000:3.0:1789672677.926231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:3.0:1789672677.926242:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318272:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789672677.926320:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926339:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926351:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926408:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926415:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926433:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926461:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926468:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926474:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672677.926511:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789672677.926515:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672677.926528:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926540:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926547:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926554:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926561:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672677.926565:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926573:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926592:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:3.0:1789672677.926595:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672677.926601:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926607:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08d33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926620:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926626:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926633:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926639:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672677.926642:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926648:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926656:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9fa611330400) 00010000:00010000:3.0:1789672677.926659:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672677.926662:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926668:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d08d3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926692:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926698:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926705:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926710:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672677.926713:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926718:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926724:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:3.0:1789672677.926727:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672677.926729:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672677.926735:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d08d41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672677.926836:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318272:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 Request processed in 595us (3887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672677.926856:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:3.0:1789672677.930296:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672677.933229:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543318528 00000100:00100000:1.0:1789672677.933255:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543318528 00000100:00100000:1.0:1789672677.933329:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:1.0:1789672677.933340:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+49:10440:x1876607543318528:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672677.933361:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672677.933385:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08d48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8a9 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933486:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933501:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933512:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672677.933523:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789672677.933621:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933629:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933635:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933641:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672677.933645:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933653:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933671:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:1.0:1789672677.933674:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672677.933680:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933686:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08d4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933727:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08d48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a9 expref: 51 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933737:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:1.0:1789672677.933740:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672677.933744:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08d48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a9 expref: 51 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672677.933755:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f000, rc 0) 00000100:00100000:1.0:1789672677.933866:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+50:10440:x1876607543318528:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 527us (3578us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789672677.933874:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:2.0:1789672677.946989:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672677.947042:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543318656 00000100:00100000:2.0:1789672677.947051:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543318656 00000100:00100000:2.0:1789672677.947105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 71 00000100:00100000:2.0:1789672677.947115:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+50:10440:x1876607543318656:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672677.947165:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672677.947279:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+50:10440:x1876607543318656:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 164us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672677.947286:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 71 00000100:00100000:3.0:1789672677.954698:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672677.956759:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543318912 00000100:00100000:0.0:1789672677.956771:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543318912 00000100:00100000:0.0:1789672677.956853:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 72 00000100:00100000:0.0:1789672677.956865:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+50:10440:x1876607543318912:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672677.956884:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672677.956888:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789672677.956912:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08d09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf89b expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.956932:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672677.956936:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672677.956949:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672677.958467:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789672677.958671:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d08d64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.958688:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d08d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.958711:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d08d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.958777:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b0 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.958817:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d08d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b0 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.958827:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672677.958830:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672677.958833:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910600, rc 0) 00000100:00100000:0.0:1789672677.959097:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+51:10440:x1876607543318912:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 2233us (4405us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789672677.959106:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 72 00000100:00100000:2.0:1789672677.982047:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672677.982202:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543319168 00000100:00100000:0.0:1789672677.982213:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543319168 00000100:00100000:0.0:1789672677.982267:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00100000:0.0:1789672677.982276:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+51:10440:x1876607543319168:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672677.982343:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672677.982369:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d08d64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b0 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982386:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672677.982398:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672677.982420:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982442:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982453:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982614:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982648:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982986:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.982995:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983003:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983011:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672677.983015:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983024:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983036:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672677.983048:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672677.983054:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983061:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08d72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983074:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983080:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983086:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983091:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672677.983094:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983594:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983610:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x33a70c26 (ffff9fa610c05c00) 00010000:00010000:0.0:1789672677.983613:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672677.983618:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672677.983625:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x33a70c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672677.983913:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+50:10440:x1876607543319168:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 1630us (1869us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672677.983933:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00100000:1.0:1789672677.999303:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672677.999393:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543319296 00000100:00100000:2.0:1789672677.999404:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543319296 00000100:00100000:2.0:1789672677.999497:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 74 00000100:00100000:2.0:1789672677.999507:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+50:10440:x1876607543319296:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672677.999527:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672677.999550:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08d80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8b7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.999585:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.999599:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.999611:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.999706:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08d80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.999723:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672677.999743:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:2.0:1789672677.999747:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672677.999750:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ec00, rc 0) 00000100:00100000:2.0:1789672677.999832:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+51:10440:x1876607543319296:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 326us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672677.999839:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 74 00000100:00100000:1.0:1789672678.006260:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672678.006480:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543319552 00000100:00100000:2.0:1789672678.006492:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543319552 00000100:00080000:1.0:1789672678.006606:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672678.006758:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:2.0:1789672678.006770:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+51:10440:x1876607543319552:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789672678.006875:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.006893:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.006905:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672678.007174:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789672678.007184:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346788397871ns, next at 347788395391ns, rc = 0 00000004:00010000:2.0:1789672678.007270:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9879137 reply state 000000006e25caa5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.007279:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672678.008890:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+53:10440:x1876607543319552:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 2113us (2632us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789672678.008910:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 75 00010000:00010000:3.0:1789672678.015205:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.015234:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.015242:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.015247:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672678.015252:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.015259:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.015275:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:3.0:1789672678.015278:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789672678.015282:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.015288:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08d8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.019118:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672678.020132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543319680 00000100:00100000:0.0:1789672678.020145:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543319680 00000100:00100000:0.0:1789672678.020305:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:0.0:1789672678.020316:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+52:10440:x1876607543319680:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672678.020342:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672678.020363:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8be expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.020423:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.020437:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.020457:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:0.0:1789672678.020461:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672678.020465:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910800, rc 0) 00000100:00100000:0.0:1789672678.020534:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+53:10440:x1876607543319680:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 220us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672678.020542:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:1.0:1789672678.030904:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.031059:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543319808 00000100:00100000:3.0:1789672678.031069:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543319808 00000100:00100000:3.0:1789672678.031120:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:3.0:1789672678.031128:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1876607543319808:12345-192.168.202.39@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789672678.031164:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:3.0:1789672678.031198:0:6682:0:(genops.c:1384:class_connect()) connect: client 7225c799-181e-4570-897c-b66842e45960, cookie 0x2247cb9491d08d9c 00002000:00100000:3.0:1789672678.031210:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7225c799-181e-4570-897c-b66842e45960/ffff9fa63adc1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789672678.031246:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789672678.031482:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789672678.031528:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9fa6186e0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672678.031609:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+6:2356:x1876607543319808:12345-192.168.202.39@tcp:8:lhsmtool_posix.0 Request processed in 479us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.031618:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:3.0:1789672678.042768:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672678.044448:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543319936 00000100:00100000:2.0:1789672678.044462:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543319936 00000100:00080000:1.0:1789672678.044569:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672678.044616:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:2.0:1789672678.044628:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:0:x1876607543319936:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1789672678.097418:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1789672678.097438:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000100:00100000:3.0:1789672678.097623:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:0:x1876607543319936:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 52991us (54860us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789672678.097634:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:3.0:1789672678.104227:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.104451:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543320192 00000100:00100000:1.0:1789672678.104477:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543320192 00000100:00100000:1.0:1789672678.104536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:1.0:1789672678.104546:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+53:10440:x1876607543320192:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672678.104830:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+54:10440:x1876607543320192:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 286us (613us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789672678.104838:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:1.0:1789672678.115877:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672678.116117:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543320448 00000100:00100000:2.0:1789672678.116132:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543320448 00000100:00100000:2.0:1789672678.116197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 77 00000100:00100000:2.0:1789672678.116207:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+54:10440:x1876607543320448:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789672678.116329:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+54:10440:x1876607543320448:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 123us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672678.116336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 77 00000100:00100000:3.0:1789672678.132005:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.132370:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543320576 00000100:00100000:1.0:1789672678.132381:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543320576 00000100:00100000:1.0:1789672678.132442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 78 00000100:00100000:1.0:1789672678.132453:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+54:10440:x1876607543320576:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672678.132473:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672678.132494:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08da3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8c5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.132561:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08daa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.132575:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.132588:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672678.132626:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672678.132646:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.132673:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08da3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8c5 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.132702:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8c5 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.132710:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:1.0:1789672678.132713:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789672678.132716:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fa00, rc 0) 00000100:00100000:1.0:1789672678.132774:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+55:10440:x1876607543320576:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 322us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672678.132782:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 78 00000100:00100000:3.0:1789672678.146253:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.146290:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543320704 00000100:00100000:3.0:1789672678.146300:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543320704 00000100:00100000:3.0:1789672678.146357:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:3.0:1789672678.146368:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543320704:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672678.146385:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672678.146408:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8cc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672678.146437:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3ce6, blocks: 0x1 00010000:00010000:3.0:1789672678.146455:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1789672678.146460:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672678.146469:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.146510:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.146524:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ce00, rc 0) 00000100:00100000:3.0:1789672678.146577:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543320704:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 211us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.146584:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:2.0:1789672678.161591:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.164499:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543320960 00000100:00100000:3.0:1789672678.164516:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543320960 00000100:00100000:3.0:1789672678.164585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:3.0:1789672678.164596:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61871d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+55:10440:x1876607543320960:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789672678.164804:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61871d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+55:10440:x1876607543320960:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 208us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.164813:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:3.0:1789672678.174126:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672678.176086:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321088 00000100:00100000:0.0:1789672678.176104:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321088 00000100:00100000:0.0:1789672678.176180:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:0.0:1789672678.176190:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:10440:x1876607543321088:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672678.176210:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672678.176236:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8d3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.176272:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.176282:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672678.176286:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672678.176291:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.176326:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.176339:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 7 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672678.176352:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564314496:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672678.176447:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6011ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672678.186555:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.186591:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321216 00000100:00100000:3.0:1789672678.186600:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321216 00010000:00010000:3.0:1789672678.186637:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 8 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.186677:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:3.0:1789672678.186686:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543321216:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672678.186722:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672678.186753:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 8 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.186766:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 8 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.186820:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672678.186825:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672678.186834:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.186854:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.186902:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.186916:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1876607564314624:192.168.202.39@tcp:105: 00000100:00100000:3.0:1789672678.186995:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789672678.187369:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d08db1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8cc expref: 8 pid: 6682 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.187384:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564314496:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672678.187406:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.187417:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910600, rc 0) 00000100:00100000:2.0:1789672678.187449:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:10440:x1876607543321088:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 11260us (13339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672678.187456:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:1.0:1789672678.199849:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1876607564314624:192.168.202.39@tcp:105: 00010000:00010000:1.0:1789672678.199877:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672678.199931:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543321216:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 13246us (13386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672678.199942:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:3.0:1789672678.203261:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672678.203426:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321344 00000100:00100000:0.0:1789672678.203437:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321344 00002000:00100000:0.0:1789672678.203487:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fa635642680 x1876607543321344/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:304/0 lens 504/0 e 0 to 0 dl 1789672689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672678.203497:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa635642680 with x1876607543321344 ext(0->8) 00002000:00010000:0.0:1789672678.203503:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa635642680 00000100:00100000:0.0:1789672678.203535:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:2.0:1789672678.203548:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789672678.203556:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543321344:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789672678.203573:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789672678.204246:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543321344:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 Request processed in 694us (993us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789672678.204256:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00002000:00100000:0.0:1789672678.204263:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fa635642680 x1876607543321344/t4294967302(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:304/0 lens 504/448 e 0 to 0 dl 1789672689 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672678.204272:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa635642680 with x1876607543321344 ext(0->8) 00002000:00010000:0.0:1789672678.204276:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa635642680 00000100:00100000:3.0:1789672678.223992:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672678.224080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321472 00000100:00100000:0.0:1789672678.224090:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321472 00000100:00100000:0.0:1789672678.224153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:0.0:1789672678.224163:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+55:10440:x1876607543321472:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1789672678.305473:0:11999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672678.305483:0:11999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672678.305518:0:11999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789672678.305523:0:11999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672678.313975:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+55:10440:x1876607543321472:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 Request processed in 89803us (89992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.313987:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 80 00000001:00080000:3.0:1789672678.314027:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1789672678.314036:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789672678.314065:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789672678.314077:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa61a755240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789672678.314080:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa62f448300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa61a755f00 00000020:00080000:3.0:1789672678.314084:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa62f448200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa633058800 00000001:00080000:3.0:1789672678.314107:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1789672678.314129:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789672678.314363:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789672678.314469:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789672678.314537:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564314752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789672678.314580:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672678.314636:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564314880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789672678.314659:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672678.314697:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564314752 00000100:00100000:3.0:1789672678.314704:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564314752 00000100:00100000:3.0:1789672678.314735:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564314880 00000100:00100000:3.0:1789672678.314739:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564314880 00000100:00100000:3.0:1789672678.314769:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672678.314776:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564314752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789672678.314821:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789672678.315234:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aac3ce3, atime: 0x6aac3ce4, ctime: 0x6aac3ce3, blocks: 0x1 00010000:00010000:3.0:1789672678.315243:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.315260:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1789672678.315264:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672678.315271:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.315300:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.315311:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.315319:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.315385:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789672678.316116:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1876607564314752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1337us (1532us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789672678.316125:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672678.316149:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789672678.316159:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564314880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789672678.316266:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789672678.316269:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789672678 00002000:00010000:3.0:1789672678.316272:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789672678.316274:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789672678 -> 1789672678 00002000:00010000:3.0:1789672678.316276:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789672678.316311:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564314880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (1651us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789672678.316318:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789672678.316349:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789672678.316887:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa635641880/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789672678.316896:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564314880:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789672678.316970:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672678.316980:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.316996:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672678.317001:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.317012:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.317045:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.317053:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c25d3734/0x2247cb9491d08dbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672678.317142:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa635641180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789672678.317148:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564314752:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789672678.317161:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672678.317163:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672678.317165:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672678.318116:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.320052:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321600 00000100:00100000:1.0:1789672678.320072:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321600 00000100:00100000:0.0:1789672678.320234:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:0.0:1789672678.320245:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543321600:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789672678.408253:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543321600:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 Request processed in 87997us (90129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.408273:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 30 00000001:00080000:3.0:1789672678.408313:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1789672678.408327:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789672678.415345:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.420205:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321856 00000100:00100000:1.0:1789672678.420224:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321856 00000100:00100000:1.0:1789672678.420294:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:1.0:1789672678.420306:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+13:10440:x1876607543321856:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672678.420362:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672678.420393:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08daa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8c5 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.420410:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:1.0:1789672678.420415:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672678.420445:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.420459:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.420470:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672678.420740:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cea1d447 reply state 00000000c4a6dffa transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672678.420750:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672678.420889:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+14:10440:x1876607543321856:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 583us (5550us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789672678.420896:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:0.0:1789672678.431433:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.434289:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543321984 00000100:00100000:1.0:1789672678.434304:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543321984 00000100:00100000:1.0:1789672678.434370:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:1.0:1789672678.434380:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543321984:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789672678.434664:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789672678.434668:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789672678 -> 1789672677 00002000:00010000:1.0:1789672678.434671:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789672676 00002000:00010000:1.0:1789672678.434674:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789672678 -> 1789672677 00002000:00010000:1.0:1789672678.434676:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789672678.435141:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543321984:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 760us (3716us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789672678.435149:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00010000:00010000:3.0:1789672678.442453:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.442967:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.442976:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.442983:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672678.442987:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.442996:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.443012:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:3.0:1789672678.443015:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672678.443020:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.443026:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08dc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.443121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.443151:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543322240 00000100:00100000:3.0:1789672678.443161:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543322240 00000100:00100000:3.0:1789672678.443213:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 82 00000100:00100000:3.0:1789672678.443223:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+13:10440:x1876607543322240:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789672678.443284:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.443297:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.443305:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.443421:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.443436:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 13 pid: 5830 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.443452:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564315008:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672678.446264:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672678.450140:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672678.450192:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543322368 00000100:00100000:2.0:1789672678.450201:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543322368 00000100:00100000:3.0:1789672678.450218:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564315008:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672678.450250:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 14 pid: 5830 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450265:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.450292:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:2.0:1789672678.450305:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+14:2358:x1876607543322368:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672678.450321:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672678.450328:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 14 pid: 5830 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.450341:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 14 pid: 5830 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.450362:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d08d87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8b7 expref: 14 pid: 5830 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.450377:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:2.0:1789672678.450383:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.450393:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.450411:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.450437:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672678.450485:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+13:2358:x1876607543322368:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 183us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672678.450491:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 43 00010000:00010000:3.0:1789672678.450643:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450654:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450708:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450721:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450729:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450737:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672678.450743:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450751:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450766:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:3.0:1789672678.450770:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789672678.450807:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.450815:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08dcd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.451250:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+12:10440:x1876607543322240:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 Request processed in 8025us (8130us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789672678.451261:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 82 00000100:00100000:3.0:1789672678.454626:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672678.459164:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543322496 00000100:00100000:2.0:1789672678.459180:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543322496 00000100:00100000:2.0:1789672678.459254:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:2.0:1789672678.459264:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543322496:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789672678.459309:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.459330:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.459339:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789672678.459343:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672678.459348:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.459381:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.459395:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 7 pid: 6685 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.459422:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611838700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876607564315136:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672678.459500:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6083c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672678.465580:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611838700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876607564315136:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672678.465634:0:8063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.469924:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.471668:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543322624 00000100:00100000:3.0:1789672678.471687:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543322624 00010000:00010000:3.0:1789672678.472232:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.472340:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:3.0:1789672678.472355:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543322624:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672678.472376:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672678.472411:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.472429:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.472458:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041de2519/0x2247cb9491d08db8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8d3 expref: 8 pid: 6685 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.472479:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672678.472484:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672678.472491:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.472503:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.472555:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672678.472636:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543322624:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 284us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.472645:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 44 00010000:00010000:2.0:1789672678.473487:0:8063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473508:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473546:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473556:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473579:0:8063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473586:0:8063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672678.473591:0:8063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473600:0:8063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473640:0:8063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.473649:0:8063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d08dd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.473745:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543322496:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 Request processed in 14477us (19129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672678.473755:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:3.0:1789672678.480482:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.480548:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543322880 00000100:00100000:3.0:1789672678.480562:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543322880 00000100:00100000:3.0:1789672678.480638:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 83 00000100:00100000:3.0:1789672678.480652:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+12:10440:x1876607543322880:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789672678.480769:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481172:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481189:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481564:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481583:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481593:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481642:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.481675:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 13 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.481694:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564315264:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672678.483762:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672678.493295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672678.493344:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543323008 00000100:00100000:3.0:1789672678.493356:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543323008 00010000:00010000:3.0:1789672678.493416:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 14 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672678.493464:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:3.0:1789672678.493477:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+14:2357:x1876607543323008:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672678.493498:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672678.493507:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 14 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.493523:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 14 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.493553:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:3.0:1789672678.493560:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.493572:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.493597:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.493623:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672678.493690:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+14:2357:x1876607543323008:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 215us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.493697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 45 00010000:00010000:1.0:1789672678.495448:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d08d95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8be expref: 13 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672678.495478:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564315264:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672678.495512:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.495548:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.495554:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672678.496207:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789672678.496549:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789672678.496600:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789672678.497122:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876607564315392:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789672678.497219:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672678.497339:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672678.497469:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564315392 00000100:00100000:3.0:1789672678.497480:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564315392 00000100:00100000:3.0:1789672678.497588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672678.497601:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1876607564315392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789672678.497726:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1876607564315392:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672678.497735:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672678.498174:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789672678.498183:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa635641880, transno 4294967303 00000100:00100000:3.0:1789672678.498210:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876607564315392:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789672678.500303:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789672678.500566:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635641c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876607564315520:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789672678.500684:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672678.500813:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672678.501109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564315520 00000100:00100000:1.0:1789672678.501119:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564315520 00000100:00100000:1.0:1789672678.501213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672678.501224:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876607564315520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789672678.501503:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1876607564315520:12345-0@lo:1000:mdt00_002.0 Request processed in 279us (821us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789672678.501511:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672678.501772:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635641c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5832:1876607564315520:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789672678.501855:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501868:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501876:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501883:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ca00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672678.501888:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501896:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501914:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa602b49100) 00010000:00010000:0.0:1789672678.501918:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672678.501923:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501929:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08de2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501978:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501985:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.501990:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.502010:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672678.502013:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.502019:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.502028:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:0.0:1789672678.502030:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672678.502033:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.502038:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08d10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.503364:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.503385:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.503393:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.503429:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672678.503444:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 16 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672678.503470:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564315648:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672678.503557:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672678.508386:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.508535:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564315648:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672678.508575:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.509279:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543323136 00000100:00100000:2.0:1789672678.509292:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543323136 00010000:00010000:2.0:1789672678.509443:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672678.509682:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:2.0:1789672678.509694:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+17:2358:x1876607543323136:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672678.509728:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672678.509736:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.509751:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.509807:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08d2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8a2 expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.509857:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:2.0:1789672678.509863:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.509874:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.509882:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672678.509910:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672678.509978:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+16:2358:x1876607543323136:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 287us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672678.509986:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 46 00010000:00010000:1.0:1789672678.510082:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510091:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510115:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510123:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510129:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510136:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672678.510140:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510148:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510156:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:1.0:1789672678.510159:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672678.510163:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510169:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d08de9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510179:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510183:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510188:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510197:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672678.510200:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510206:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510214:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:1.0:1789672678.510216:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672678.510219:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.510224:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08ddb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672678.510766:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+15:10440:x1876607543322880:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 30114us (30297us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789672678.510775:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 83 00000020:00080000:1.0:1789672678.510779:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789672678.512209:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672678.512218:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672678.512256:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789672678.512263:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672678.516446:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672678.516611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543323392 00000100:00100000:1.0:1789672678.516625:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543323392 00000100:00100000:1.0:1789672678.516705:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:1.0:1789672678.516718:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+15:10440:x1876607543323392:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789672678.521393:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789672678.521622:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789672678.521722:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.521745:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.521770:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.521782:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.521813:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.522680:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672678.522701:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672678.523146:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672678.523166:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.523174:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672678.523179:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.523189:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.523208:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa6184b6b00) 00010000:00010000:3.0:1789672678.523211:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789672678.523219:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.523226:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08df0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672678.523252:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672678.523253:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672678.523255:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672678.523458:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+17:10440:x1876607543323392:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 6736us (7021us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789672678.523470:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00000020:00080000:1.0:1789672678.523478:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789672678.643255:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672679.347994:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672679.348028:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564315776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672679.348125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672679.348358:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564315776 00000100:00100000:2.0:1789672679.348370:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564315776 00000100:00100000:2.0:1789672679.348436:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789672679.348446:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564315776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672679.348493:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672679.348557:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564315776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672679.348564:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789672679.349141:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564316288:0@lo:400:kworker.0 00000100:00100000:1.0:1789672679.349187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672679.349219:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672679.349224:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564316160:0@lo:400:kworker.0 00000100:00100000:1.0:1789672679.349249:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672679.349319:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564315904:0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349374:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672679.349413:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564316416:0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349435:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672679.349453:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672679.349458:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564316032:0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672679.349505:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564316160 00000100:00100000:3.0:1789672679.349511:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564316160 00000100:00100000:3.0:1789672679.349567:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564316416 00000100:00100000:3.0:1789672679.349571:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564316416 00000100:00100000:3.0:1789672679.349589:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564316032 00000100:00100000:3.0:1789672679.349591:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564316032 00000100:00100000:3.0:1789672679.349606:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789672679.349612:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564316160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349657:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564316160:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672679.349664:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789672679.349678:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789672679.349684:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564316416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349714:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564316416:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672679.349720:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789672679.349733:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789672679.349739:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564316032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349765:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564316032:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672679.349770:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789672679.349822:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672679.349866:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564316032:0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.349879:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564316416:0@lo:400:kworker.0 00000100:00100000:0.0:1789672679.350086:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564315776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672679.350215:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564315904 00000100:00100000:1.0:1789672679.350220:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564315904 00000100:00100000:1.0:1789672679.350264:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789672679.350271:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564315904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672679.350339:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564315904:12345-0@lo:400:kworker.0 Request processed in 62us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672679.350356:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789672679.350398:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564316160:0@lo:400:kworker.0 00000100:00100000:2.0:1789672679.350594:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564316288 00000100:00100000:2.0:1789672679.350599:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564316288 00000100:00100000:2.0:1789672679.350651:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789672679.350658:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672679.350711:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564316288:12345-0@lo:400:kworker.0 Request processed in 54us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672679.350717:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1789672679.350777:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672679.350860:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564316288:0@lo:400:kworker.0 00000100:00100000:3.0:1789672679.351476:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564315904:0@lo:400:kworker.0 00010000:00010000:0.0:1789672679.667217:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672680.422435:0:12051:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672680.422448:0:12051:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672680.422492:0:12051:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789672680.422498:0:12051:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672680.589074:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672680.589357:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543323648 00000100:00100000:1.0:1789672680.589372:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543323648 00000100:00100000:1.0:1789672680.589468:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:1.0:1789672680.589481:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+17:10458:x1876607543323648:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672680.589527:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672680.589555:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08df7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8da expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.589689:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08dfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.589708:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.589726:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08dfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672680.589740:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789672680.589944:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08df7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8da expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.589983:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08dfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8da expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.589992:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672680.589995:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789672680.590000:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e000, rc 0) 00000100:00100000:1.0:1789672680.590084:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+19:10458:x1876607543323648:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 605us (1026us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789672680.590092:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00080000:0.0:1789672680.590444:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672680.595392:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672680.595483:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543323776 00000100:00100000:2.0:1789672680.595508:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543323776 00000100:00100000:2.0:1789672680.595586:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 85 00000100:00100000:2.0:1789672680.595599:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+19:10458:x1876607543323776:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:2.0:1789672680.595922:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.595946:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.595962:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.595983:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.595992:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596001:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596380:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596391:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596413:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672680.596478:0:7918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596719:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596729:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596739:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596747:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672680.596753:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.596765:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597006:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672680.597010:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672680.597019:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597027:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597043:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597060:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597066:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597071:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672680.597075:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597082:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597092:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa602b49e00) 00010000:00010000:2.0:1789672680.597095:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672680.597098:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597105:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597125:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597132:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597138:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597144:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672680.597153:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597161:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597169:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49600) 00010000:00010000:2.0:1789672680.597172:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672680.597287:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.597297:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d08e1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672680.597407:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+19:10458:x1876607543323776:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 1805us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672680.597418:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 85 00000100:00100000:1.0:1789672680.643325:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672680.643504:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543324032 00000100:00100000:2.0:1789672680.643519:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543324032 00000100:00100000:2.0:1789672680.643595:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 86 00000100:00100000:2.0:1789672680.643609:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+19:10462:x1876607543324032:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672680.643640:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672680.643671:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.643771:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.643827:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.643866:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.643884:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.643893:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.643901:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.645760:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.645830:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.645845:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672680.645862:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789672680.646980:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647004:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647013:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647020:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672680.647036:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647046:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647065:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672680.647068:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672680.647074:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647082:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647096:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647104:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647110:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647115:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672680.647118:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647124:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647132:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa602b49600) 00010000:00010000:2.0:1789672680.647135:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672680.647145:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647151:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647257:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.647266:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:2.0:1789672680.647268:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672680.647271:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fc00, rc 0) 00000100:00100000:2.0:1789672680.647391:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+21:10462:x1876607543324032:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 3784us (4076us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789672680.647403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 86 00000100:00100000:1.0:1789672680.665526:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672680.665577:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543324160 00000100:00100000:1.0:1789672680.665589:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543324160 00000100:00100000:1.0:1789672680.665673:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:1.0:1789672680.665687:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+21:10462:x1876607543324160:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:1.0:1789672680.665777:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670489:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670522:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670567:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670594:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670602:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670609:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672680.670614:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670624:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670639:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:1.0:1789672680.670642:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672680.670649:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.670657:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08e44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672680.670798:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+21:10462:x1876607543324160:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 5092us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672680.670811:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:1.0:1789672680.673487:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672680.673575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543324416 00000100:00100000:0.0:1789672680.673588:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543324416 00000100:00100000:0.0:1789672680.675405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:0.0:1789672680.675432:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+21:10462:x1876607543324416:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672680.675809:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+22:10462:x1876607543324416:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 387us (2336us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789672680.675828:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 21 00010000:00010000:2.0:1789672680.691012:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672680.725880:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672680.726068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543324672 00000100:00100000:2.0:1789672680.726083:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543324672 00000100:00100000:2.0:1789672680.726202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 88 00000100:00100000:2.0:1789672680.726214:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+22:9981:x1876607543324672:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672680.726251:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672680.726280:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8e8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.726439:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.726476:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.726486:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.726533:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.726549:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 23 pid: 5831 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672680.726566:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61183a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564316544:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672680.726697:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6083c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672680.732811:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672680.732968:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61183a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564316544:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672680.733009:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672680.733161:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543324800 00000100:00100000:3.0:1789672680.733181:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543324800 00010000:00010000:3.0:1789672680.733234:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 24 pid: 5831 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672680.733305:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:3.0:1789672680.733332:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+24:2357:x1876607543324800:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672680.733365:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672680.733375:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 24 pid: 5831 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.733707:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 24 pid: 5831 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.733741:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08e36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e1 expref: 24 pid: 5831 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.733759:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:3.0:1789672680.733766:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.733778:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.733844:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.733881:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672680.733951:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+23:2357:x1876607543324800:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 635us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672680.733960:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 47 00010000:00010000:2.0:1789672680.734032:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.734041:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672680.734069:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789672680.734310:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.734364:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.734373:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:2.0:1789672680.734376:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672680.734379:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f200, rc 0) 00000100:00100000:2.0:1789672680.734681:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+23:9981:x1876607543324672:12345-192.168.202.39@tcp:101:bash.0 Request processed in 8468us (8814us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789672680.734690:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 88 00000100:00100000:3.0:1789672680.741772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672680.741997:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325056 00000100:00100000:2.0:1789672680.742015:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325056 00000100:00100000:2.0:1789672680.742096:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 89 00000100:00100000:2.0:1789672680.742120:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+23:9981:x1876607543325056:12345-192.168.202.39@tcp:36:bash.0 00010000:00010000:2.0:1789672680.742684:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.742710:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.742724:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672680.742826:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789672680.742861:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8f4e88d reply state 00000000a3044072 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672680.742871:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789672680.742937:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789672680.743085:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+27:9981:x1876607543325056:12345-192.168.202.39@tcp:36:bash.0 Request processed in 976us (1326us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789672680.743094:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 89 00000020:00080000:2.0:1789672680.743101:0:7918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789672680.745036:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.745057:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.745068:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.745075:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672680.745081:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.745089:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.745108:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:3.0:1789672680.745111:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672680.745117:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.745124:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672680.746868:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672680.747011:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325184 00000100:00100000:1.0:1789672680.747026:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325184 00000100:00100000:1.0:1789672680.747114:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 90 00000100:00100000:1.0:1789672680.747149:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:9981:x1876607543325184:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:1.0:1789672680.747188:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672680.747215:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8ef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.747300:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8ef expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.747318:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8ef expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.747357:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:1.0:1789672680.747360:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672680.747365:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fa00, rc 0) 00000100:00100000:1.0:1789672680.747444:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+27:9981:x1876607543325184:12345-192.168.202.39@tcp:101:bash.0 Request processed in 299us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672680.747451:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 90 00000100:00100000:1.0:1789672680.751704:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672680.751841:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325312 00000100:00100000:3.0:1789672680.751856:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325312 00000100:00100000:3.0:1789672680.751939:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:3.0:1789672680.751951:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+6:9981:x1876607543325312:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672680.751975:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672680.752011:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8f6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672680.752072:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aac3ce5, atime: 0x6aac3ce4, ctime: 0x6aac3ce5, blocks: 0xb 00010000:00010000:3.0:1789672680.752101:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1789672680.752106:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672680.752116:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.752139:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.752155:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d600, rc 0) 00000100:00100000:3.0:1789672680.752239:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+7:9981:x1876607543325312:12345-192.168.202.39@tcp:101:bash.0 Request processed in 290us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672680.752247:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00080000:0.0:1789672680.753039:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672680.755928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672680.756119:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325440 00000100:00100000:0.0:1789672680.756133:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325440 00002000:00010000:0.0:1789672680.756193:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789672680.756199:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa635643b80 with x1876607543325440 ext(0->18446744073709551615) 00002000:00010000:0.0:1789672680.756216:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa635643b80. 00000100:00100000:0.0:1789672680.756258:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:0.0:1789672680.756269:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543325440:12345-192.168.202.39@tcp:10:bash.0 00002000:00010000:0.0:1789672680.756777:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789672680.756782:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789672677 -> 1789672681 00002000:00010000:0.0:1789672680.756835:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789672676 -> 1789672676 00002000:00010000:0.0:1789672680.756837:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789672677 -> 1789672681 00002000:00010000:0.0:1789672680.756840:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789672680.756908:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543325440:12345-192.168.202.39@tcp:10:bash.0 Request processed in 641us (995us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789672680.756917:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00002000:00010000:0.0:1789672680.756922:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789672680.756925:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa635643b80 with x1876607543325440 ext(0->18446744073709551615) 00002000:00010000:0.0:1789672680.756929:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa635643b80. 00000100:00100000:1.0:1789672680.840683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672680.841296:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325568 00000100:00100000:2.0:1789672680.841311:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325568 00000100:00100000:2.0:1789672680.841533:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 91 00000100:00100000:2.0:1789672680.841546:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+27:10476:x1876607543325568:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:2.0:1789672680.842059:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.842084:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.842100:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.842494:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.842504:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672680.842512:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.845311:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847454:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847479:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672680.847567:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847585:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847624:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847634:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847641:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672680.847647:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847656:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847672:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672680.847676:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672680.847682:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847689:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08e75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847712:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847725:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847732:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847737:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672680.847748:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847755:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847764:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa602b49600) 00010000:00010000:3.0:1789672680.847767:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672680.847771:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847777:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08e7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847851:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847859:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847866:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847871:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67dc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672680.847875:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847881:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847889:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:3.0:1789672680.847892:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672680.847902:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672680.847908:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08e83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672680.848055:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+27:10476:x1876607543325568:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 6505us (7378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672680.848068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 91 00000100:00100000:1.0:1789672680.922115:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672680.922166:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325824 00000100:00100000:1.0:1789672680.922180:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325824 00000100:00100000:1.0:1789672680.922256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 92 00000100:00100000:1.0:1789672680.922269:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+27:10479:x1876607543325824:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672680.922297:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672680.922348:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf8fd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922479:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922498:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922513:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922531:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922539:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922546:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922896:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08e9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922907:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.922914:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672680.922927:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789672680.923230:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923238:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923255:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923262:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672680.923268:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923278:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923296:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672680.923300:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672680.923308:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923316:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08e91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923332:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923339:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923344:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923350:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672680.923610:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923633:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923643:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa6184b6000) 00010000:00010000:1.0:1789672680.923646:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672680.923649:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923655:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08e98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923718:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d08e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8fd expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923736:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08e9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8fd expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.923744:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:1.0:1789672680.923746:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789672680.923749:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672680.923880:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+29:10479:x1876607543325824:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1612us (1783us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789672680.923889:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 92 00000100:00100000:0.0:1789672680.929551:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672680.929643:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543325952 00000100:00100000:1.0:1789672680.929659:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543325952 00000100:00100000:1.0:1789672680.929737:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 93 00000100:00100000:1.0:1789672680.929750:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+29:10479:x1876607543325952:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:1.0:1789672680.929906:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.929929:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.929947:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.929994:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672680.930011:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 29 pid: 5830 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672680.930029:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f6ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564316672:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672680.930160:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672680.937115:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f6ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564316672:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672680.937163:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672680.938552:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672680.938600:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543326208 00000100:00100000:1.0:1789672680.938612:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543326208 00000100:00100000:1.0:1789672680.938685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:1.0:1789672680.938698:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+30:5595:x1876607543326208:12345-192.168.202.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789672680.939276:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+31:5595:x1876607543326208:12345-192.168.202.39@tcp:35:ldlm_bl.0 Request processed in 578us (728us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789672680.939286:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:3.0:1789672680.942280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672680.953614:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543326336 00000100:00100000:0.0:1789672680.953638:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543326336 00010000:00010000:0.0:1789672680.953715:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 31 pid: 5830 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672680.953775:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:0.0:1789672680.953808:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+31:2357:x1876607543326336:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672680.954034:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672680.954045:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 31 pid: 5830 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954090:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 31 pid: 5830 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954121:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08e52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8e8 expref: 31 pid: 5830 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954142:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:0.0:1789672680.954148:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954160:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954181:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954218:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672680.954304:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+30:2357:x1876607543326336:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 518us (12036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672680.954313:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 48 00010000:00010000:0.0:1789672680.954633:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954644:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954696:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954718:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954726:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954734:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672680.954740:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954750:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954762:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:0.0:1789672680.954765:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672680.954770:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672680.954777:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672680.954890:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+29:10479:x1876607543325952:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 25142us (25354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672680.954899:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 93 00000100:00100000:3.0:1789672680.958319:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672680.958688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543326592 00000100:00100000:0.0:1789672680.958702:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543326592 00000100:00100000:0.0:1789672680.958780:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:0.0:1789672680.958841:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+29:10479:x1876607543326592:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672680.960424:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+30:10479:x1876607543326592:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 1575us (2109us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789672680.960463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 23 00000001:00080000:1.0:1789672680.984751:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1789672680.984776:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1789672680.984845:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789672681.086091:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.086454:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543326848 00000100:00100000:1.0:1789672681.086470:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543326848 00000100:00100000:1.0:1789672681.086560:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 94 00000100:00100000:1.0:1789672681.086574:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+30:10490:x1876607543326848:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:1.0:1789672681.086611:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672681.086642:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf904 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.086864:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.086884:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.086897:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.086915:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.086922:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.086928:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.087963:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08ec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.087978:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088228:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672681.088244:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789672681.088506:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088516:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088523:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088530:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.088535:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088545:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088560:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672681.088563:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.088570:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088576:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ebb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088591:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088597:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088611:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088616:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.088619:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088625:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088633:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa6184b6300) 00010000:00010000:1.0:1789672681.088636:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.088639:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088644:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.088780:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf904 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.089076:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf904 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.089084:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:1.0:1789672681.089086:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672681.089090:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fe00, rc 0) 00000100:00100000:1.0:1789672681.089557:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+32:10490:x1876607543326848:12345-192.168.202.39@tcp:101:cat.0 Request processed in 2983us (3477us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789672681.089582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 94 00000100:00100000:2.0:1789672681.096944:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.097085:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543327104 00000100:00100000:1.0:1789672681.097107:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543327104 00000100:00100000:1.0:1789672681.097192:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:1.0:1789672681.097206:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+32:10490:x1876607543327104:12345-192.168.202.39@tcp:35:cat.0 00000100:00100000:1.0:1789672681.097595:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+33:10490:x1876607543327104:12345-192.168.202.39@tcp:35:cat.0 Request processed in 391us (668us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789672681.097605:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:3.0:1789672681.137450:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.137507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.137556:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.137590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.137640:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543327360 00000100:00100000:3.0:1789672681.137653:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543327360 00000100:00100000:0.0:1789672681.137842:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543327232 00000100:00100000:0.0:1789672681.137847:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543327232 00000100:00100000:0.0:1789672681.137908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 285 00000100:00100000:0.0:1789672681.137921:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543327232:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672681.138031:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543327232:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 112us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672681.138040:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 285 00000100:00100000:2.0:1789672681.138461:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543327488 00000100:00100000:2.0:1789672681.138468:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543327488 00000100:00100000:2.0:1789672681.138516:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:2.0:1789672681.138524:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+8:2360:x1876607543327488:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672681.138591:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+8:2360:x1876607543327488:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 67us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672681.138599:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:1.0:1789672681.138875:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543327616 00000100:00100000:1.0:1789672681.138881:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543327616 00000100:00100000:1.0:1789672681.138945:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 133 00000100:00100000:1.0:1789672681.138954:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543327616:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672681.139002:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543327616:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 49us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.139008:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 133 00000100:00100000:3.0:1789672681.139587:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:3.0:1789672681.139597:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543327360:12345-192.168.202.39@tcp:400:kworker.0 00000100:00080000:2.0:1789672681.139820:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672681.139828:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672681.140980:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543327360:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 1373us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672681.140995:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:2.0:1789672681.143545:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.144511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543327872 00000100:00100000:1.0:1789672681.144529:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543327872 00000100:00100000:1.0:1789672681.144628:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 95 00000100:00100000:1.0:1789672681.144642:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+33:10491:x1876607543327872:12345-192.168.202.39@tcp:36:rm.0 00010000:00010000:1.0:1789672681.145666:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789672681.146555:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08ec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf904 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.146589:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08e9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8fd expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.146635:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08e67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8ef expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.146647:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa602b49e00) 00010000:00010000:1.0:1789672681.146662:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672681.147518:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.147544:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.147557:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.147578:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.147585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.147593:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.148841:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.148859:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.148870:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672681.151972:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789672681.151993:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349933206116ns, next at 350933200399ns, rc = 0 00010000:00010000:1.0:1789672681.152475:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152498:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152515:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152526:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152534:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152542:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152621:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672681.152657:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152664:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152685:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152692:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.152713:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152721:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152735:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:1.0:1789672681.152739:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789672681.152745:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152752:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08ee5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152777:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.152805:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.153006:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.153012:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.153014:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.153021:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.153029:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672681.153032:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.153043:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.153049:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ed7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672681.153063:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022fc3517 reply state 00000000259720fd transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.153075:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672681.153234:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+32:10491:x1876607543327872:12345-192.168.202.39@tcp:36:rm.0 Request processed in 8589us (9699us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789672681.153246:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 95 00010000:00010000:2.0:1789672681.154228:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672681.154239:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.154248:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672681.154253:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.154262:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.154278:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa6184b6000) 00010000:00010000:2.0:1789672681.154282:0:8499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789672681.154287:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.154294:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08eec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.154318:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672681.154434:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672681.154436:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672681.156909:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.156956:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.156964:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.156971:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672681.156977:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.156985:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.157004:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa6184b6300) 00010000:00010000:2.0:1789672681.157007:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672681.157013:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.157020:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08ede lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672681.200182:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.200277:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543328128 00000100:00100000:1.0:1789672681.200294:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543328128 00000100:00100000:1.0:1789672681.200415:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 96 00000100:00100000:1.0:1789672681.200429:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+31:10497:x1876607543328128:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:1.0:1789672681.200467:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672681.200496:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ef3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf90b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.200666:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.200699:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.200713:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.200733:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.200766:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.200774:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789672681.201685:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789672681.201989:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202005:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202018:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202079:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202088:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202096:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202104:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672681.202109:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202119:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202135:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672681.202139:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672681.202146:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202153:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08efa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672681.202171:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f0bcf0e reply state 000000000c60b3e3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672681.202182:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789672681.202225:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ef3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202257:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.202265:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:2.0:1789672681.202268:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672681.202271:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f600, rc 0) 00000100:00100000:2.0:1789672681.202376:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+34:10497:x1876607543328128:12345-192.168.202.39@tcp:101:bash.0 Request processed in 1949us (2209us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789672681.202387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 96 00010000:00010000:1.0:1789672681.208114:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.208129:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:1.0:1789672681.208137:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.208147:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.208155:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.208162:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.208177:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.208202:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa6184b6900) 00010000:00010000:1.0:1789672681.208206:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.208212:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.208219:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672681.208545:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543328256 00000100:00100000:2.0:1789672681.208561:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543328256 00000100:00100000:2.0:1789672681.208634:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:2.0:1789672681.208647:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543328256:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672681.208670:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672681.208695:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf912 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672681.208728:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672681.208755:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1789672681.208761:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672681.208771:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.208830:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.208879:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f400, rc 0) 00000100:00100000:2.0:1789672681.208970:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543328256:12345-192.168.202.39@tcp:101:bash.0 Request processed in 326us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672681.208979:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:3.0:1789672681.212580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.212701:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543328384 00000100:00100000:0.0:1789672681.212715:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543328384 00000100:00100000:0.0:1789672681.212831:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:0.0:1789672681.212844:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:10497:x1876607543328384:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:0.0:1789672681.212867:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672681.212901:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf919 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.212941:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.212952:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672681.212957:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672681.212963:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.213022:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.213056:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672681.213073:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876607564316800:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672681.213222:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672681.216357:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8063:1876607564316800:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672681.216411:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.216440:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911200, rc 0) 00000100:00100000:2.0:1789672681.216520:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:10497:x1876607543328384:12345-192.168.202.39@tcp:101:bash.0 Request processed in 3678us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672681.216531:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:2.0:1789672681.221140:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.221240:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543328512 00000100:00100000:3.0:1789672681.221255:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543328512 00010000:00010000:3.0:1789672681.221323:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.221449:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:3.0:1789672681.221463:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543328512:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672681.221483:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672681.221515:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.221535:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.221570:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf912 expref: 7 pid: 6685 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.221593:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789672681.221599:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672681.221612:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.221625:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.221706:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.221742:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1876607564316928:192.168.202.39@tcp:105: 00000100:00100000:3.0:1789672681.222130:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa641b64480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672681.226091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.226497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543328768 00000100:00100000:1.0:1789672681.226532:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543328768 00000100:00100000:1.0:1789672681.226621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:1.0:1789672681.226635:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+33:10497:x1876607543328768:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:1.0:1789672681.227227:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+34:10497:x1876607543328768:12345-192.168.202.39@tcp:35:bash.0 Request processed in 593us (1152us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789672681.227238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:2.0:1789672681.227495:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5815:1876607564316928:192.168.202.39@tcp:105: 00010000:00010000:2.0:1789672681.227525:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672681.227553:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543328512:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 6094us (6431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672681.227563:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:2.0:1789672681.379158:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.379385:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543328896 00000100:00100000:1.0:1789672681.379403:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543328896 00000100:00100000:1.0:1789672681.379498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 97 00000100:00100000:1.0:1789672681.379514:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+34:10513:x1876607543328896:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672681.379553:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672681.379585:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf920 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.379685:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08f2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.379703:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.379980:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672681.380097:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789672681.380103:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672681.380127:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.380164:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d08f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf920 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.380212:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf920 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.380222:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672681.380225:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672681.380231:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672681.381041:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+35:10513:x1876607543328896:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1524us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.381053:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 97 00000100:00100000:3.0:1789672681.384656:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.385207:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543329152 00000100:00100000:0.0:1789672681.385223:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543329152 00000100:00100000:0.0:1789672681.385325:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 98 00000100:00100000:0.0:1789672681.385337:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+35:10513:x1876607543329152:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672681.385366:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672681.385396:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08f32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf927 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.385552:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.385572:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.385589:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672681.385603:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789672681.386097:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08f32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf927 expref: 38 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.386122:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf927 expref: 37 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.386153:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:0.0:1789672681.386157:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672681.386162:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910a00, rc 0) 00000100:00100000:0.0:1789672681.386272:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+37:10513:x1876607543329152:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 936us (1631us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789672681.387235:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 98 00000100:00100000:3.0:1789672681.390467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.390658:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543329408 00000100:00100000:2.0:1789672681.390673:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543329408 00000100:00100000:2.0:1789672681.390756:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 99 00000100:00100000:2.0:1789672681.390770:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+37:10513:x1876607543329408:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672681.391060:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672681.391092:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08f47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf92e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.391242:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d08f4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.391264:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d08f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.391294:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d08f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672681.391314:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789672681.391489:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d08f47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf92e expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.391512:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d08f4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf92e expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.391521:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:2.0:1789672681.391524:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789672681.391529:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ee00, rc 0) 00000100:00100000:2.0:1789672681.391632:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+39:10513:x1876607543329408:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 864us (1179us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789672681.391640:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 99 00000100:00100000:1.0:1789672681.398741:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.399015:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543329536 00000100:00100000:0.0:1789672681.399030:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543329536 00000100:00100000:0.0:1789672681.399121:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672681.399134:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+39:2358:x1876607543329536:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672681.399154:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672681.399187:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf927 expref: 39 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.399213:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:0.0:1789672681.399220:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672681.399298:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+38:2358:x1876607543329536:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 167us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672681.399306:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:3.0:1789672681.402378:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.402503:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543329664 00000100:00100000:2.0:1789672681.402518:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543329664 00000100:00100000:2.0:1789672681.402592:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:2.0:1789672681.402617:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543329664:12345-192.168.202.39@tcp:1:lfs.0 00010000:00010000:2.0:1789672681.402686:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.402711:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.402720:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672681.402726:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672681.402731:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.402781:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 6 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.402845:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 6 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672681.402865:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61183a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876607564317056:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672681.403227:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6012ed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672681.408324:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.408390:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543329792 00000100:00100000:0.0:1789672681.408404:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543329792 00002000:00100000:0.0:1789672681.408471:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fa63f6aad80 x1876607543329792/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:307/0 lens 504/0 e 0 to 0 dl 1789672692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672681.408483:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63f6aad80 with x1876607543329792 ext(0->8) 00010000:00010000:0.0:1789672681.408495:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 7 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.408532:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 7 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672681.408542:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa63f6aad80 00000100:00100000:0.0:1789672681.408589:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:0.0:1789672681.408600:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543329792:12345-192.168.202.39@tcp:4:lfs.0 00000100:00100000:0.0:1789672681.409538:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7225c799-181e-4570-897c-b66842e45960+9:2357:x1876607543329792:12345-192.168.202.39@tcp:4:lfs.0 Request processed in 933us (1224us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789672681.409550:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00002000:00100000:0.0:1789672681.409559:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fa63f6aad80 x1876607543329792/t4294967302(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:307/0 lens 504/448 e 0 to 0 dl 1789672692 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672681.409568:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63f6aad80 with x1876607543329792 ext(0->8) 00010000:00010000:0.0:1789672681.409575:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 9 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.409591:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 9 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672681.409599:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa63f6aad80 00000100:00100000:2.0:1789672681.409781:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61183a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1876607564317056:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672681.409849:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.412155:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.412488:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543329920 00000100:00100000:2.0:1789672681.412500:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543329920 00010000:00010000:2.0:1789672681.412563:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 9 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672681.412616:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 50 00000100:00100000:2.0:1789672681.412627:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+9:2359:x1876607543329920:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672681.412647:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789672681.412673:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789672681.412677:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789672681 00002000:00010000:2.0:1789672681.412679:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789672682 00002000:00010000:2.0:1789672681.412683:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789672681 00010000:00010000:2.0:1789672681.412690:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 9 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.412706:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 9 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.412749:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8f04010/0x2247cb9491d08f1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf919 expref: 9 pid: 8063 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.412770:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672681.412776:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672681.412783:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.412837:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.412896:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672681.412962:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+8:2359:x1876607543329920:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 336us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672681.412970:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 50 00010000:00010000:1.0:1789672681.413119:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413130:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413163:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413172:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413181:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413200:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672681.413205:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413216:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413230:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.413238:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd193ee4/0x2247cb9491d08f5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.413305:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543329664:12345-192.168.202.39@tcp:1:lfs.0 Request processed in 10691us (10942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.413313:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:2.0:1789672681.416264:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.416565:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543330176 00000100:00100000:1.0:1789672681.416579:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543330176 00000100:00100000:1.0:1789672681.416688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:1.0:1789672681.416700:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+38:10513:x1876607543330176:12345-192.168.202.39@tcp:35:lfs.0 00000004:00010000:1.0:1789672681.416837:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d08f4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf92e expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672681.417280:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789672681.417344:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789672681.417769:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789672681.417879:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.417899:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.417910:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.417960:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.417981:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 42 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.418001:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f6a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876607564317184:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672681.418137:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789672681.423436:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.423508:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543330304 00000100:00100000:1.0:1789672681.423521:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543330304 00010000:00010000:1.0:1789672681.423584:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 43 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.423633:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:1.0:1789672681.423644:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+43:2358:x1876607543330304:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672681.423667:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672681.423676:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 43 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.423719:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 43 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.423752:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:1.0:1789672681.423760:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.423772:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.423782:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.423838:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672681.423925:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+43:2358:x1876607543330304:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 282us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.423934:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 51 00010000:00010000:3.0:1789672681.426399:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d08f08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf90b expref: 42 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.426431:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f6a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876607564317184:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672681.426467:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.426658:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.426668:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672681.427194:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789672681.427549:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789672681.427713:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a54e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564317312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789672681.428080:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672681.428169:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a60c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672681.428226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564317312 00000100:00100000:3.0:1789672681.428238:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564317312 00000100:00100000:3.0:1789672681.428426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672681.428439:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876607564317312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789672681.428556:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876607564317312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672681.428564:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672681.428643:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789672681.428652:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1789672681.428683:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa635641180, transno 4294967301 00000100:00100000:0.0:1789672681.428709:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a54e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564317312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789672681.429334:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789672681.429417:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a54e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564317440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789672681.429461:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672681.429482:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672681.430015:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564317440 00000100:00100000:3.0:1789672681.430024:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564317440 00000100:00100000:3.0:1789672681.430061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789672681.430070:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876607564317440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789672681.430269:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876607564317440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (806us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789672681.430277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672681.430607:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a54e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564317440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789672681.430681:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789672681.430734:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.430749:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.430759:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.430767:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672681.430774:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.430833:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.430856:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:0.0:1789672681.430860:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789672681.430961:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.430969:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d08f63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672681.431278:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789672681.431471:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789672681.431486:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350212699303ns, next at 351212696711ns, rc = 0 00000001:00080000:0.0:1789672681.431497:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789672681.431543:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa602b49700) 00010000:00010000:0.0:1789672681.431546:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789672681.431556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ee00/0x2247cb9491d08f4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf92e expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672681.431776:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+45:10513:x1876607543330176:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 15077us (15523us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789672681.431838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 26 00000020:00080000:0.0:1789672681.431846:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1789672681.432111:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672681.435495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.435608:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543330432 00000100:00100000:0.0:1789672681.435621:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543330432 00000100:00100000:0.0:1789672681.435747:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 100 00000100:00100000:0.0:1789672681.435761:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+45:10513:x1876607543330432:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672681.435896:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672681.435929:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf935 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.436034:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf935 expref: 46 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.436053:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf935 expref: 46 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.436078:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672681.436081:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672681.436086:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910a00, rc 0) 00000100:00100000:0.0:1789672681.436169:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+46:10513:x1876607543330432:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 411us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672681.436175:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 100 00000100:00100000:1.0:1789672681.454336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.454508:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543330688 00000100:00100000:0.0:1789672681.454523:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543330688 00000100:00100000:0.0:1789672681.454617:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:0.0:1789672681.454629:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+46:10513:x1876607543330688:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672681.455696:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+47:10513:x1876607543330688:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 1059us (1372us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789672681.455711:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:2.0:1789672681.566165:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.566655:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543330816 00000100:00100000:1.0:1789672681.566669:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543330816 00000100:00100000:1.0:1789672681.566940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 101 00000100:00100000:1.0:1789672681.566955:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+47:10523:x1876607543330816:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:1.0:1789672681.567072:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567094:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567131:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567145:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567150:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567155:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567258:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567263:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567267:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672681.567323:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567340:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567348:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567356:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567372:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.567376:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567382:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567393:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672681.567396:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.567400:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567404:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d08f71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567417:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567420:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567424:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567427:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.567428:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567432:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567442:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa6184b6900) 00010000:00010000:1.0:1789672681.567444:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.567446:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567449:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08f78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567462:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567465:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567468:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567471:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.567473:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567477:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567480:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.567481:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.567483:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.567486:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d08f7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.569121:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+47:10523:x1876607543330816:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 2161us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.569133:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 101 00000100:00100000:3.0:1789672681.621360:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.621606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543331072 00000100:00100000:2.0:1789672681.621620:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543331072 00000100:00100000:2.0:1789672681.621703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 102 00000100:00100000:2.0:1789672681.621727:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+47:10526:x1876607543331072:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672681.621756:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672681.621834:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08f86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf93c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622267:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622295:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622308:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622348:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622356:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622363:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622512:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622521:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622527:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672681.622538:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789672681.622663:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622672:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622679:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622686:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672681.622691:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622709:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622723:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672681.622726:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672681.622732:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622739:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d08f8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622756:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622761:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622767:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622772:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672681.622775:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622781:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.622848:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa602b49f00) 00010000:00010000:2.0:1789672681.622851:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672681.622855:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.623212:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d08f94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.623269:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d08f86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.623300:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.623308:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672681.623310:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672681.623313:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fa00, rc 0) 00000100:00100000:2.0:1789672681.623400:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+49:10526:x1876607543331072:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1676us (2057us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789672681.623410:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 102 00000100:00100000:2.0:1789672681.627860:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.628112:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543331200 00000100:00100000:1.0:1789672681.628127:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543331200 00000100:00100000:1.0:1789672681.628212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 103 00000100:00100000:1.0:1789672681.628225:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+49:10526:x1876607543331200:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:1.0:1789672681.628357:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628382:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628396:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628431:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628439:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628447:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628453:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.628495:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628505:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628552:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.628555:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672681.628561:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.628568:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08fa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.628674:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+49:10526:x1876607543331200:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 444us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.628683:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 103 00000100:00100000:1.0:1789672681.633646:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.634111:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543331456 00000100:00100000:2.0:1789672681.634126:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543331456 00000100:00100000:2.0:1789672681.634194:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 28 00000100:00100000:2.0:1789672681.634206:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+49:10526:x1876607543331456:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672681.634534:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+50:10526:x1876607543331456:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 328us (901us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789672681.634543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 28 00000100:00100000:3.0:1789672681.706976:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.707125:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543331712 00000100:00100000:0.0:1789672681.707144:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543331712 00000100:00100000:0.0:1789672681.707230:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 104 00000100:00100000:0.0:1789672681.707245:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+50:10536:x1876607543331712:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:0.0:1789672681.707302:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672681.707307:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789672681.707378:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08f2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf920 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.707411:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672681.707420:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672681.707443:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08fb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf943 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.707628:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.707648:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.707659:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.707718:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.707738:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 50 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672681.707759:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564317568:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672681.707980:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672681.714432:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564317568:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672681.714494:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.715990:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.718059:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543331840 00000100:00100000:2.0:1789672681.718083:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543331840 00010000:00010000:2.0:1789672681.718153:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 51 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672681.718308:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:2.0:1789672681.718321:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+51:2357:x1876607543331840:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672681.718345:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672681.718353:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 51 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.718370:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 51 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.718400:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d08f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf93c expref: 51 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.718422:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672681.718429:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.718474:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.718482:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.718511:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672681.718594:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+50:2357:x1876607543331840:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 275us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672681.718602:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 52 00010000:00010000:0.0:1789672681.718687:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672681.718708:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.718718:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672681.718748:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789672681.718983:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d08fb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 51 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.719004:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 50 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.719011:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672681.719014:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672681.719016:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911c00, rc 0) 00000100:00100000:0.0:1789672681.719047:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+50:10536:x1876607543331712:12345-192.168.202.39@tcp:101:bash.0 Request processed in 11808us (12089us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789672681.719056:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 104 00000100:00100000:1.0:1789672681.727304:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.727458:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543332096 00000100:00100000:3.0:1789672681.727472:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543332096 00000100:00100000:3.0:1789672681.727553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 105 00000100:00100000:3.0:1789672681.727565:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+50:10536:x1876607543332096:12345-192.168.202.39@tcp:36:bash.0 00010000:00010000:3.0:1789672681.727967:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.728169:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.728187:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672681.728254:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789672681.728349:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c4055de reply state 000000006f88c3d3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.728360:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672681.728498:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+53:10536:x1876607543332096:12345-192.168.202.39@tcp:36:bash.0 Request processed in 933us (1219us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789672681.728508:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 105 00000020:00080000:3.0:1789672681.728513:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789672681.736173:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:2.0:1789672681.736280:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.736315:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.736325:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.736333:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67dc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672681.736340:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.736350:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.736376:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672681.736380:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672681.736387:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672681.736394:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d08fc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.736529:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543332224 00000100:00100000:3.0:1789672681.736544:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543332224 00000100:00100000:3.0:1789672681.736621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 106 00000100:00100000:3.0:1789672681.736633:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+52:10536:x1876607543332224:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672681.736667:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672681.736698:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08fcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf94a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.737425:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.737448:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 53 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.737459:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.737507:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 53 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.737525:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 53 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.737542:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564317696:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672681.737657:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa641b64f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672681.744206:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564317696:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672681.744251:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672681.744894:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.744987:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543332352 00000100:00100000:1.0:1789672681.744998:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543332352 00010000:00010000:1.0:1789672681.745052:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 54 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.745106:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:1.0:1789672681.745117:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+54:2358:x1876607543332352:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672681.745135:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672681.745144:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 54 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.745158:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 54 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.745186:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d08fb7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf943 expref: 54 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.745225:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.745231:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.745244:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.745254:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.745290:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672681.745319:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.745327:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.745367:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+53:2358:x1876607543332352:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 251us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.745375:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 53 00000004:00200000:3.0:1789672681.745402:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789672681.745409:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672681.745442:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.745486:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08fcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.745506:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.745514:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:3.0:1789672681.745517:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672681.745519:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c400, rc 0) 00000100:00100000:3.0:1789672681.745551:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+52:10536:x1876607543332224:12345-192.168.202.39@tcp:101:bash.0 Request processed in 8922us (9394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672681.745560:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 106 00000100:00100000:1.0:1789672681.749163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672681.749281:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543332608 00000100:00100000:2.0:1789672681.749296:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543332608 00000100:00100000:2.0:1789672681.749365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:2.0:1789672681.749379:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+52:10536:x1876607543332608:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:2.0:1789672681.749680:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+53:10536:x1876607543332608:12345-192.168.202.39@tcp:35:bash.0 Request processed in 303us (527us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789672681.749688:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:0.0:1789672681.861928:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.862089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543332736 00000100:00100000:3.0:1789672681.862105:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543332736 00000100:00100000:3.0:1789672681.862182:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 107 00000100:00100000:3.0:1789672681.862196:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+53:10542:x1876607543332736:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672681.862231:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672681.862262:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf951 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.862375:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.862418:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.862434:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672681.862482:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789672681.862486:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672681.862507:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.862540:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d08fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf951 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.862569:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf951 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.862579:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672681.862582:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672681.862587:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ca00, rc 0) 00000100:00100000:3.0:1789672681.867489:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+54:10542:x1876607543332736:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 5276us (5557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672681.867508:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 107 00000100:00100000:0.0:1789672681.876157:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.876453:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543332864 00000100:00100000:1.0:1789672681.876466:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543332864 00000100:00100000:1.0:1789672681.876537:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 108 00000100:00100000:1.0:1789672681.876548:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+54:10542:x1876607543332864:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672681.876576:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672681.876603:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf958 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876682:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876698:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876736:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876758:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876766:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876773:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876921:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876932:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.876939:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672681.877054:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789672681.877060:0:7918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672681.877088:0:7918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877103:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877112:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877130:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877138:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877146:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.877152:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877160:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877175:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:1.0:1789672681.877178:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.877185:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877192:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d08fef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877206:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877212:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877218:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877223:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672681.877235:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877242:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877250:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa6184b6900) 00010000:00010000:1.0:1789672681.877253:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672681.877256:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877262:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d08ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877550:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d08fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 56 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877568:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 55 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.877576:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.877578:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672681.877581:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672681.878099:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+55:10542:x1876607543332864:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1547us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.878109:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 108 00000100:00100000:0.0:1789672681.883620:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.883889:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672681.884014:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543333120 00000100:00100000:3.0:1789672681.884028:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543333120 00000100:00100000:3.0:1789672681.884103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 109 00000100:00100000:3.0:1789672681.884115:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+55:10542:x1876607543333120:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672681.884144:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672681.884184:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf95f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.884514:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.884533:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.884542:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 56 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.884552:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.884602:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 56 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.884620:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 56 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.884650:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564317824:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672681.885288:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.885302:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.885314:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564317952:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672681.885359:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa641b64000 going to sleep for 11 seconds 00000100:00100000:1.0:1789672681.885559:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543333248 00000100:00100000:1.0:1789672681.885569:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543333248 00010000:00010000:1.0:1789672681.885608:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 57 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.886086:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 54 00000100:00100000:1.0:1789672681.886097:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+57:2357:x1876607543333248:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672681.886113:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672681.886120:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 57 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.886134:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 57 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.886157:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.886162:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.886171:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.886178:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672681.886212:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+57:2357:x1876607543333248:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 118us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.886220:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 54 00010000:00010000:3.0:1789672681.890745:0:5831:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.39@tcp) returned -22 from blocking AST (req@00000000b20d186c x1876607564317824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 56 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.890776:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d08ffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf958 expref: 56 pid: 7918 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672681.890831:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564317824:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672681.890847:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564317952:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672681.890874:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:3.0:1789672681.890880:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.890892:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672681.890903:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672681.891147:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.891258:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543333376 00000100:00100000:1.0:1789672681.891267:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543333376 00010000:00010000:1.0:1789672681.891322:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672681.891375:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:1.0:1789672681.891387:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+56:2358:x1876607543333376:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672681.891415:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672681.891422:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.891436:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.891458:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d08fd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf94a expref: 56 pid: 5832 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.891472:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.891475:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.891484:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.891493:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.891528:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672681.891599:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+55:2358:x1876607543333376:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 213us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.891607:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 55 00010000:00010000:0.0:1789672681.892567:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.892582:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672681.892609:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789672681.892873:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.892898:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.892907:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672681.892910:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672681.892913:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d200, rc 0) 00000100:00100000:0.0:1789672681.893085:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+55:10542:x1876607543333120:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 8970us (9478us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789672681.893096:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 109 00000100:00100000:0.0:1789672681.895907:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.896009:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543333632 00000100:00100000:1.0:1789672681.896024:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543333632 00000100:00100000:1.0:1789672681.896110:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:1.0:1789672681.896123:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+55:10542:x1876607543333632:12345-192.168.202.39@tcp:103:lfs.0 00010000:00010000:1.0:1789672681.896165:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672681.896198:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d08f6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf935 expref: 55 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.896221:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.896227:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672681.896310:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+54:10542:x1876607543333632:12345-192.168.202.39@tcp:103:lfs.0 Request processed in 189us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.896318:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:1.0:1789672681.903913:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672681.904024:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543333760 00000100:00100000:0.0:1789672681.904040:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543333760 00000100:00100000:0.0:1789672681.904118:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 110 00000100:00100000:0.0:1789672681.904132:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+54:10542:x1876607543333760:12345-192.168.202.39@tcp:58:lfs.0 00010000:00010000:0.0:1789672681.904310:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.904334:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672681.904362:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672681.904612:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789672681.904729:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+54:10542:x1876607543333760:12345-192.168.202.39@tcp:58:lfs.0 Request processed in 599us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672681.904738:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 110 00000100:00100000:0.0:1789672681.908163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672681.908244:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543333888 00000100:00100000:1.0:1789672681.908257:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543333888 00000100:00100000:1.0:1789672681.908341:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 111 00000100:00100000:1.0:1789672681.908352:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+54:10542:x1876607543333888:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672681.908382:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672681.908410:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.908487:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.908499:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.908524:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.908539:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.908575:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672681.908579:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672681.908583:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672681.908592:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f800, rc 0) 00000100:00100000:1.0:1789672681.908662:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+55:10542:x1876607543333888:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 311us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672681.908670:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 111 00000100:00100000:2.0:1789672682.419162:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564318080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672682.419292:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672682.419451:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564318080 00000100:00100000:0.0:1789672682.419462:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564318080 00000100:00100000:0.0:1789672682.419534:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789672682.419547:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564318080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672682.419578:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672682.419643:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564318080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.419650:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789672682.419764:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564318080:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789672682.611846:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672682.611859:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672682.611943:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789672682.611950:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672682.612406:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564318208:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672682.612639:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672682.622070:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564318208:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672682.624703:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.624835:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543334016 00000100:00100000:0.0:1789672682.624849:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543334016 00000100:00100000:0.0:1789672682.624930:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 112 00000100:00100000:0.0:1789672682.624944:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+55:10543:x1876607543334016:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672682.625001:0:7918:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672682.625138:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+55:10543:x1876607543334016:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 199us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.625147:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 112 00000100:00080000:2.0:1789672682.625533:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672682.630782:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672682.630926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543334144 00000100:00100000:1.0:1789672682.630940:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543334144 00000100:00100000:1.0:1789672682.631763:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 113 00000100:00100000:1.0:1789672682.631782:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+55:10543:x1876607543334144:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789672682.631919:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.631937:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.631951:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.634663:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.634687:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.634715:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.634904:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.634915:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.634922:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672682.634970:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789672682.634975:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672682.634991:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635004:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635011:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635018:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635024:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672682.635028:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635035:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635055:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:1.0:1789672682.635058:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672682.635063:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635069:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09027 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635086:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635092:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635098:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635103:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672682.635105:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635111:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635117:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9fa6184b6900) 00010000:00010000:1.0:1789672682.635119:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672682.635121:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635127:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0902e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635157:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635164:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635170:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635176:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672682.635179:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635185:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635193:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672682.635195:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672682.635198:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.635204:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.635395:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+55:10543:x1876607543334144:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 Request processed in 3616us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672682.635405:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 113 00000100:00100000:1.0:1789672682.637458:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.637531:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543334400 00000100:00100000:0.0:1789672682.637540:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543334400 00000100:00100000:0.0:1789672682.637594:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:0.0:1789672682.637601:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+55:10543:x1876607543334400:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672682.637618:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672682.637634:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0903c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf96d expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637710:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637720:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637728:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672682.637748:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789672682.637901:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637909:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637934:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637939:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672682.637943:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637950:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637961:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672682.637964:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789672682.637968:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.637975:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.638015:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0903c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf96d expref: 57 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.638025:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672682.638027:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672682.638031:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0903c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf96d expref: 57 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.638041:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911600, rc 0) 00000100:00100000:0.0:1789672682.638107:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+56:10543:x1876607543334400:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 505us (654us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789672682.638123:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:2.0:1789672682.656222:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.656376:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543334528 00000100:00100000:0.0:1789672682.656387:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543334528 00000100:00100000:0.0:1789672682.656451:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:0.0:1789672682.656461:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+56:10543:x1876607543334528:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672682.656500:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672682.656667:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+56:10543:x1876607543334528:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 205us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.656675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:1.0:1789672682.668931:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.668974:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543334784 00000100:00100000:0.0:1789672682.668984:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543334784 00000100:00100000:0.0:1789672682.669101:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 116 00000100:00100000:0.0:1789672682.669112:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+56:10543:x1876607543334784:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672682.669144:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672682.669147:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789672682.669176:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d08fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf951 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.669198:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672682.669203:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672682.669217:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09051 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf974 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672682.669610:0:7918:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789672682.670012:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.670056:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.670073:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.670177:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09051 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf974 expref: 58 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.670199:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf974 expref: 57 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.670206:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa610c05c00) 00010000:00010000:0.0:1789672682.670209:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672682.670213:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672682.670384:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+57:10543:x1876607543334784:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1271us (1458us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789672682.670395:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 116 00000100:00100000:0.0:1789672682.689928:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.690450:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543335040 00000100:00100000:3.0:1789672682.690461:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543335040 00000100:00100000:3.0:1789672682.690520:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 117 00000100:00100000:3.0:1789672682.690529:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+57:10543:x1876607543335040:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789672682.690590:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672682.690618:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf974 expref: 57 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690647:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa610c05c00) 00010000:00010000:3.0:1789672682.690659:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672682.690680:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690693:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690702:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690755:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690763:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690769:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690881:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690889:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690896:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690902:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672682.690906:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690920:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690929:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:3.0:1789672682.690932:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672682.690936:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690941:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09066 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690952:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690957:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690962:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690967:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672682.690969:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690975:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.690981:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x78ff8aee (ffff9fa611330800) 00010000:00010000:3.0:1789672682.690984:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672682.690986:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.691002:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0906d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x78ff8aee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672682.691105:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+56:10543:x1876607543335040:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 576us (1184us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672682.691113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 117 00000100:00100000:2.0:1789672682.692871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.693018:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543335168 00000100:00100000:3.0:1789672682.693027:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543335168 00000100:00100000:3.0:1789672682.693076:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 118 00000100:00100000:3.0:1789672682.693087:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+56:10543:x1876607543335168:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672682.693104:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672682.693122:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09074 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf97b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.693155:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.693166:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.693176:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.693271:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09074 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.693304:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.693323:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:3.0:1789672682.693325:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789672682.693328:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c200, rc 0) 00000100:00100000:3.0:1789672682.693384:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+57:10543:x1876607543335168:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 299us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672682.693391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 118 00000100:00100000:1.0:1789672682.700225:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.700391:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543335424 00000100:00100000:3.0:1789672682.700401:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543335424 00000100:00100000:3.0:1789672682.700457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 119 00000100:00100000:3.0:1789672682.700467:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+57:10543:x1876607543335424:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789672682.700541:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.700557:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.700567:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672682.702084:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789672682.702101:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351483314217ns, next at 352483310577ns, rc = 0 00000004:00010000:2.0:1789672682.702206:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000012da7f4 reply state 000000007f28899c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672682.702217:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672682.702453:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+59:10543:x1876607543335424:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 1984us (2235us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789672682.702463:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 119 00010000:00010000:1.0:1789672682.706458:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.706476:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.706484:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.706490:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672682.706495:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.706503:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.706520:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:1.0:1789672682.706523:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672682.706528:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.706534:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09082 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672682.708108:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672682.708296:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543335552 00000100:00100000:2.0:1789672682.708305:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543335552 00000100:00100000:2.0:1789672682.708358:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:2.0:1789672682.708366:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+58:10543:x1876607543335552:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672682.708388:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672682.708406:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf982 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.708460:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.708474:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.708508:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:2.0:1789672682.708511:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672682.708514:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fa00, rc 0) 00000100:00100000:2.0:1789672682.708565:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+59:10543:x1876607543335552:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 200us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672682.708572:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:2.0:1789672682.711250:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.711329:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543335680 00000100:00100000:3.0:1789672682.711340:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543335680 00000100:00100000:3.0:1789672682.711414:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:3.0:1789672682.711426:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543335680:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789672682.712863:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672682.713044:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+9:2357:x1876607543335680:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 1618us (1799us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789672682.713069:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:1.0:1789672682.718293:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.718493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543335936 00000100:00100000:0.0:1789672682.718505:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543335936 00000100:00100000:0.0:1789672682.718614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:0.0:1789672682.718623:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+59:10543:x1876607543335936:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789672682.718900:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+60:10543:x1876607543335936:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 276us (616us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789672682.718907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:1.0:1789672682.721883:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.721973:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543336192 00000100:00100000:0.0:1789672682.721982:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543336192 00000100:00100000:0.0:1789672682.722066:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 121 00000100:00100000:0.0:1789672682.722074:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+60:10543:x1876607543336192:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789672682.722162:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+60:10543:x1876607543336192:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.722167:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 121 00000100:00100000:1.0:1789672682.729697:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672682.729830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543336320 00000100:00100000:2.0:1789672682.729840:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543336320 00000100:00100000:2.0:1789672682.729923:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 122 00000100:00100000:2.0:1789672682.729935:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+60:10543:x1876607543336320:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672682.729959:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672682.729981:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09090 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf989 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.730054:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d09097 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.730069:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d09097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.730093:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d09097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672682.730131:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672682.730151:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d09097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.730187:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09090 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf989 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.730206:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d09097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf989 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.730215:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:2.0:1789672682.730218:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789672682.730224:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ea00, rc 0) 00000100:00100000:2.0:1789672682.730294:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+61:10543:x1876607543336320:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 361us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672682.730301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 122 00000100:00100000:1.0:1789672682.737509:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.737623:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543336448 00000100:00100000:3.0:1789672682.737634:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543336448 00000100:00100000:3.0:1789672682.737742:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:3.0:1789672682.737761:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+9:2359:x1876607543336448:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672682.737783:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672682.737861:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf990 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672682.737893:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3ceb, blocks: 0x1 00010000:00010000:3.0:1789672682.737922:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789672682.737927:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672682.737936:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.737954:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.737968:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672682.738159:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+10:2359:x1876607543336448:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 406us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672682.738167:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 38 00010000:00010000:2.0:1789672682.739417:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672682.740435:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672682.740517:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543336704 00000100:00100000:2.0:1789672682.740527:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543336704 00000100:00100000:2.0:1789672682.740588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 123 00000100:00100000:2.0:1789672682.740599:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+61:10543:x1876607543336704:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789672682.740729:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+61:10543:x1876607543336704:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672682.740737:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 123 00000100:00100000:2.0:1789672682.750547:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.750967:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543336832 00000100:00100000:0.0:1789672682.751145:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543336832 00000100:00100000:0.0:1789672682.751256:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:0.0:1789672682.751268:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61db56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+10:10543:x1876607543336832:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672682.751287:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672682.751306:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf997 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.751339:0:8063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.751348:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672682.751352:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672682.751357:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 11 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.751395:0:8063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.751429:0:8063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672682.751445:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f795f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876607564318336:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672682.751563:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f5609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672682.755256:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f795f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8063:1876607564318336:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672682.755294:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 11 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.755315:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911600, rc 0) 00000100:00100000:0.0:1789672682.755494:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61db56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+11:10543:x1876607543336832:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 4226us (4956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.755503:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:1.0:1789672682.756513:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.760147:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543336960 00000100:00100000:0.0:1789672682.760164:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543336960 00010000:00010000:0.0:1789672682.760215:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672682.760280:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 56 00000100:00100000:0.0:1789672682.760290:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+11:2357:x1876607543336960:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672682.760306:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672682.760331:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.760366:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.760397:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfa0630/0x2247cb9491d0909e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf990 expref: 11 pid: 6682 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.760418:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672682.760423:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672682.760431:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.760440:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.760485:0:11163:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 10 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672682.760501:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f795500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11163:1876607564318464:192.168.202.39@tcp:105: 00000100:00100000:0.0:1789672682.761044:0:11163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f5609c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672682.768580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672682.769890:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543337088 00000100:00100000:2.0:1789672682.769904:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543337088 00002000:00100000:2.0:1789672682.769984:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fa63a057800 x1876607543337088/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:308/0 lens 504/0 e 0 to 0 dl 1789672693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672682.770013:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63a057800 with x1876607543337088 ext(0->12) 00002000:00010000:2.0:1789672682.770020:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa63a057800 00000100:00100000:2.0:1789672682.770057:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:2.0:1789672682.770067:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7225c799-181e-4570-897c-b66842e45960+11:2358:x1876607543337088:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789672682.770577:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7225c799-181e-4570-897c-b66842e45960+13:2358:x1876607543337088:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 Request processed in 508us (2003us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789672682.770586:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00002000:00100000:2.0:1789672682.770596:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fa63a057800 x1876607543337088/t4294967308(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:308/0 lens 504/448 e 0 to 0 dl 1789672693 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672682.770605:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63a057800 with x1876607543337088 ext(0->12) 00002000:00010000:2.0:1789672682.770609:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa63a057800 00000100:00100000:2.0:1789672682.776333:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.776491:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f795500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11163:1876607564318464:192.168.202.39@tcp:105: 00010000:00010000:0.0:1789672682.776517:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672682.776578:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+12:2357:x1876607543336960:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 16289us (20069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.776590:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 56 00000100:00100000:3.0:1789672682.781780:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543337216 00000100:00100000:3.0:1789672682.781826:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543337216 00000100:00100000:3.0:1789672682.782222:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 124 00000100:00100000:3.0:1789672682.782239:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+61:10543:x1876607543337216:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789672682.868001:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789672682.868069:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789672682.868094:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa604c9b180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789672682.868100:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa608039400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa604c9b9c0 00000020:00080000:1.0:1789672682.868104:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa608039900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa63a221c00 00000004:00080000:1.0:1789672682.868154:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1789672682.868215:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789672682.868230:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa611f24840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789672682.868233:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa610ec5200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa611f24240 00000020:00080000:1.0:1789672682.868246:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa610ec5e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa639bbe400 00000020:00080000:1.0:1789672682.868253:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1789672682.868456:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564318592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789672682.868558:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672682.868631:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672682.868637:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564318720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789672682.868660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672682.868699:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564318592 00000100:00100000:1.0:1789672682.868709:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564318592 00000100:00100000:1.0:1789672682.868771:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564318720 00000100:00100000:1.0:1789672682.868774:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564318720 00000100:00100000:1.0:1789672682.869053:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789672682.869065:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564318592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789672682.869116:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1789672682.869155:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.869186:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.869214:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789672682.869219:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672682.869225:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.869263:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.869281:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 11 pid: 6682 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.869296:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a055500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564318848:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672682.869388:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672682.869412:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789672682.869421:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564318720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789672682.870105:0:8063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789672682.870113:0:8063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789672683 00002000:00010000:1.0:1789672682.870126:0:8063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789672682.870129:0:8063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789672683 -> 1789672683 00002000:00010000:1.0:1789672682.870132:0:8063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789672682.870215:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1876607564318720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 794us (1553us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789672682.870225:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1789672682.870293:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa63a055880/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789672682.870312:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564318720:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1789672682.871147:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789672682.871400:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789672682.871930:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672682.871952:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564318976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789672682.872032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672682.872078:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564318976 00000100:00100000:2.0:1789672682.872087:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564318976 00000100:00100000:2.0:1789672682.872309:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672682.872320:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564318976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789672682.872362:0:8063:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789672682.872404:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aac3ce9, atime: 0x6aac3cea, ctime: 0x6aac3ce9, blocks: 0x1 00010000:00010000:2.0:1789672682.872415:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.872628:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1789672682.872635:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672682.872643:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.872664:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.872676:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.872684:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.872705:0:8063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672682.875141:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a055500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564318848:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672682.875184:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.875711:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.876055:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543337344 00000100:00100000:3.0:1789672682.876066:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543337344 00010000:00010000:3.0:1789672682.876120:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 12 pid: 6682 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672682.876169:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:3.0:1789672682.876181:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+12:2358:x1876607543337344:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672682.876200:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672682.876207:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 12 pid: 6682 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.876223:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 12 pid: 6682 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.876252:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f60c3e85/0x2247cb9491d08e6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8f6 expref: 12 pid: 6682 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.876505:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672682.876512:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672682.876520:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.876597:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.876657:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672682.876723:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+11:2358:x1876607543337344:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 543us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672682.876732:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 57 00010000:00010000:3.0:1789672682.877015:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.877029:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.877044:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.877055:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.877078:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789672682.878298:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1876607564318976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5970us (6255us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789672682.878314:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1789672682.878366:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672682.878376:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878390:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672682.878397:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878425:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878458:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878467:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003294804c/0x2247cb9491d090b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878494:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672682.878498:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878506:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672682.878510:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878518:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878727:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878737:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d090ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.878766:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672682.878768:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672682.878771:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672682.878946:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789672682.879126:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa611838e00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789672682.879136:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564318976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789672682.880143:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3299:x1876607564318592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11075us (11580us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789672682.880157:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1789672682.880195:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672682.880632:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+15:10543:x1876607543337216:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 Request processed in 98287us (104197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.880646:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 124 00000004:00080000:1.0:1789672682.882195:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa63a055180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789672682.882211:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564318592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789672682.883047:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.883584:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543337472 00000100:00100000:3.0:1789672682.883598:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543337472 00000100:00100000:3.0:1789672682.883934:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:3.0:1789672682.883947:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+11:2357:x1876607543337472:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789672682.941068:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+11:2357:x1876607543337472:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 Request processed in 57105us (58008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672682.941085:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 43 00000001:00080000:2.0:1789672682.944504:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1789672682.944658:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1789672682.944672:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789672682.944686:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1789672682.946145:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672682.946643:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543337728 00000100:00100000:1.0:1789672682.946657:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543337728 00000100:00100000:1.0:1789672682.946745:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 125 00000100:00100000:1.0:1789672682.946758:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+15:10543:x1876607543337728:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672682.947011:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672682.947048:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d09097 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf989 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.947075:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:1.0:1789672682.947082:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672682.947122:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.947139:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.947176:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672682.948989:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009357a615 reply state 000000009c4f250a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.949013:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672682.949169:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+16:10543:x1876607543337728:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 2409us (3032us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789672682.949180:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 125 00010000:00010000:2.0:1789672682.953665:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.953688:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.953697:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.953704:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672682.953710:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.953719:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.953739:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:2.0:1789672682.953743:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672682.953749:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672682.953756:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d090ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.955036:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672682.955146:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543337856 00000100:00100000:2.0:1789672682.955160:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543337856 00000100:00100000:2.0:1789672682.955230:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:2.0:1789672682.955241:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543337856:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789672682.956580:0:8063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789672682.956589:0:8063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789672683 -> 1789672682 00002000:00010000:2.0:1789672682.956592:0:8063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789672682 00002000:00010000:2.0:1789672682.956594:0:8063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789672683 -> 1789672682 00002000:00010000:2.0:1789672682.956596:0:8063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789672682.956739:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543337856:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 1495us (1709us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789672682.956752:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:1.0:1789672682.960589:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.960654:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543338112 00000100:00100000:0.0:1789672682.960670:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543338112 00000100:00100000:0.0:1789672682.960955:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 126 00000100:00100000:0.0:1789672682.960969:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+15:10543:x1876607543338112:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789672682.961074:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.961095:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.961106:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.961148:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672682.961165:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 15 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672682.961182:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f795180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564319104:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672682.961305:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672682.965335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672682.965453:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f795180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564319104:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672682.965501:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543338240 00000100:00100000:3.0:1789672682.965512:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543338240 00010000:00010000:1.0:1789672682.965564:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966001:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672682.966040:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 58 00000100:00100000:3.0:1789672682.966052:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+16:2358:x1876607543338240:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672682.966070:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672682.966078:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966093:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966121:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d0907b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf97b expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966143:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:3.0:1789672682.966148:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966162:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966172:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.966205:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672682.966395:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966405:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966443:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966452:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966460:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966473:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672682.966478:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966487:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672682.966533:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+15:2358:x1876607543338240:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 472us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672682.966542:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 58 00010000:00010000:1.0:1789672682.966563:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:1.0:1789672682.966566:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789672682.966571:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.966577:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d090c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.966626:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:10543:x1876607543338112:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 Request processed in 5661us (6051us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789672682.966637:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 126 00000100:00100000:1.0:1789672682.971457:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672682.974421:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543338368 00000100:00100000:0.0:1789672682.974442:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543338368 00000100:00100000:3.0:1789672682.974967:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:3.0:1789672682.974993:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543338368:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789672682.975053:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.975080:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.975090:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672682.975095:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672682.975100:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.975145:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 7 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672682.975161:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 7 pid: 8063 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672682.975178:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876607564319232:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672682.975401:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa641b64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672682.981078:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672682.981092:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1876607564319232:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672682.981129:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.981159:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543338496 00000100:00100000:1.0:1789672682.981169:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543338496 00010000:00010000:1.0:1789672682.981218:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 8 pid: 8063 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.981264:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:1.0:1789672682.981275:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543338496:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672682.981295:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672682.981399:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 8 pid: 8063 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.981427:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 8 pid: 8063 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.981462:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d090a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf997 expref: 8 pid: 8063 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.981482:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672682.981773:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672682.981783:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.981843:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.981879:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672682.981958:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543338496:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 684us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672682.981966:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 59 00010000:00010000:1.0:1789672682.982480:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982558:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982599:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982620:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982629:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982637:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672682.982643:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982653:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982669:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.982677:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051685cef/0x2247cb9491d090c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.983549:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543338368:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 Request processed in 8498us (12042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672682.983565:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:0.0:1789672682.987686:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672682.991614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543338752 00000100:00100000:1.0:1789672682.991636:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543338752 00000100:00100000:1.0:1789672682.991821:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 127 00000100:00100000:1.0:1789672682.991854:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+14:10543:x1876607543338752:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672682.991967:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.991989:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.992004:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.992278:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.992291:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.992300:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.992362:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672682.992380:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 15 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672682.992397:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564319360:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672682.992528:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672683.004914:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564319360:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672683.004968:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672683.006425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672683.006659:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543338880 00000100:00100000:0.0:1789672683.006673:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543338880 00010000:00010000:0.0:1789672683.006836:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672683.006885:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:0.0:1789672683.006899:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+16:2358:x1876607543338880:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672683.006923:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672683.006933:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.006951:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.006978:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d09089 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf982 expref: 16 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.007001:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:0.0:1789672683.007006:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.007016:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.007043:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.007069:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672683.007144:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+15:2358:x1876607543338880:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 249us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672683.007153:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 60 00010000:00010000:1.0:1789672683.007242:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.007252:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672683.007878:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789672683.008070:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789672683.008118:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789672683.008243:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876607564319488:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789672683.009462:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672683.009593:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672683.009670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564319488 00000100:00100000:0.0:1789672683.009683:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564319488 00000100:00100000:0.0:1789672683.009861:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672683.009875:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1876607564319488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789672683.009995:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1876607564319488:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672683.010004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672683.010106:0:5831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789672683.010114:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1789672683.010141:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa63a055880, transno 4294967309 00000004:00080000:1.0:1789672683.010160:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa63a055180, transno 4294967310 00000100:00100000:1.0:1789672683.010169:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876607564319488:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789672683.012843:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789672683.012966:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876607564319616:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789672683.013075:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672683.013119:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672683.013458:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564319616 00000100:00100000:0.0:1789672683.013469:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564319616 00000100:00100000:0.0:1789672683.013601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672683.013613:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1876607564319616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789672683.014914:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876607564319616:12345-0@lo:1000:mdt00_001.0 Request processed in 1296us (1833us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789672683.014928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789672683.015063:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1876607564319616:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789672683.015119:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015132:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015162:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015169:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672683.015175:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015183:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015203:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa611330700) 00010000:00010000:1.0:1789672683.015206:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672683.015212:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015219:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d090d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015257:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015264:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015269:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015274:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672683.015277:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015292:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015775:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672683.015781:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672683.015836:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015851:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015863:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.015919:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672683.015936:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a054700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564319744:192.168.202.39@tcp:105: 00000100:00100000:1.0:1789672683.016035:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672683.020573:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a054700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564319744:192.168.202.39@tcp:105: 00010000:00010000:1.0:1789672683.020626:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020639:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09019 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020684:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020822:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020839:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020853:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020860:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020867:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020873:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672683.020877:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020886:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020900:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672683.020903:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672683.020908:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020914:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d090dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020925:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020940:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020946:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020951:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672683.020953:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020959:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020968:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672683.020970:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672683.020973:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.020978:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d090cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672683.021502:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672683.021509:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789672683.021878:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+18:10543:x1876607543338752:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 29455us (33634us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789672683.021890:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 127 00000020:00080000:1.0:1789672683.021898:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789672683.024505:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672683.024864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543339008 00000100:00100000:1.0:1789672683.024882:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543339008 00000100:00100000:1.0:1789672683.024976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:1.0:1789672683.024990:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+18:10542:x1876607543339008:12345-192.168.202.39@tcp:49:lfs.0 00000100:00100000:1.0:1789672683.025197:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+18:10542:x1876607543339008:12345-192.168.202.39@tcp:49:lfs.0 Request processed in 209us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672683.025204:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00000040:00080000:3.0:1789672683.026320:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789672683.026339:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672683.026622:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672683.029467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543339264 00000100:00100000:2.0:1789672683.029972:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543339264 00000100:00100000:2.0:1789672683.030063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:2.0:1789672683.030075:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+18:10543:x1876607543339264:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789672683.033122:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789672683.033259:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789672683.034467:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.034554:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.034588:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.034600:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.034606:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.034612:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.034644:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789672683.035058:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+20:10543:x1876607543339264:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 4978us (8432us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789672683.035071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 32 00000020:00080000:2.0:1789672683.035079:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789672683.037432:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672683.037510:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672683.037595:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672683.037886:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543339520 00000100:00100000:0.0:1789672683.037900:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543339520 00000100:00100000:0.0:1789672683.038479:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 128 00000100:00100000:0.0:1789672683.038505:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+20:10542:x1876607543339520:12345-192.168.202.39@tcp:58:lfs.0 00010000:00010000:3.0:1789672683.038691:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672683.038699:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672683.038713:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672683.038745:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa602b49f00) 00010000:00010000:3.0:1789672683.038749:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789672683.038756:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672683.038762:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d090e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672683.038822:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672683.038824:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672683.038827:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672683.038892:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789672683.039025:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+20:10542:x1876607543339520:12345-192.168.202.39@tcp:58:lfs.0 Request processed in 534us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672683.039035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 128 00000100:00100000:1.0:1789672683.084915:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672683.085073:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543339648 00000100:00100000:0.0:1789672683.085088:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543339648 00000100:00100000:0.0:1789672683.085171:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 129 00000100:00100000:0.0:1789672683.085183:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+20:10545:x1876607543339648:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672683.085221:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672683.085250:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d090eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf99e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.085348:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.085368:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.085384:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.085401:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.085408:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.085415:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.086046:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.086075:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.086084:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.086130:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672683.086146:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 21 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672683.086163:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f795180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564319872:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672683.087049:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672683.090672:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672683.090843:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543339904 00000100:00100000:2.0:1789672683.090856:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543339904 00000100:00100000:2.0:1789672683.090930:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:2.0:1789672683.090942:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+22:5596:x1876607543339904:12345-192.168.202.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789672683.091287:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+23:5596:x1876607543339904:12345-192.168.202.39@tcp:35:ldlm_bl.0 Request processed in 346us (629us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789672683.091296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:0.0:1789672683.092151:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f795180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564319872:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672683.092191:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672683.095602:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672683.098184:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543340032 00000100:00100000:1.0:1789672683.098206:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543340032 00010000:00010000:1.0:1789672683.098284:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 23 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672683.100557:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:1.0:1789672683.100594:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+23:2358:x1876607543340032:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672683.100624:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672683.100639:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 23 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.100663:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 23 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.100696:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0900b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf95f expref: 23 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.100735:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672683.100742:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.100777:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.100829:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672683.100887:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672683.100986:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+22:2358:x1876607543340032:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 412us (5401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672683.100996:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 61 00010000:00010000:2.0:1789672683.101135:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101159:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672683.101218:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789672683.101223:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672683.101248:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101263:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101275:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101283:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101290:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101297:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672683.101316:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101326:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101337:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:2.0:1789672683.101340:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672683.101344:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101362:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d090f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101376:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101382:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101388:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101393:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672683.101397:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101403:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101410:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa610c05400) 00010000:00010000:2.0:1789672683.101413:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672683.101416:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101422:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d090f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101465:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d090eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf99e expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101481:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf99e expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672683.101496:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672683.101498:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672683.101501:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911a00, rc 0) 00000100:00100000:2.0:1789672683.101532:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+21:10545:x1876607543339648:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 16352us (16633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672683.101540:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 129 00010000:00010000:0.0:1789672683.763041:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672684.083346:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672684.083358:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672684.083411:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789672684.083420:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672684.084133:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a056680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564320000:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789672684.084296:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611d3dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672684.091472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672684.091849:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543340160 00000100:00100000:3.0:1789672684.091863:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543340160 00000100:00100000:3.0:1789672684.091949:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 130 00000100:00100000:3.0:1789672684.091974:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+22:10556:x1876607543340160:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789672684.092032:0:7918:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789672684.092172:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+22:10556:x1876607543340160:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 212us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.092180:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 130 00000100:00100000:1.0:1789672684.092777:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a056680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564320000:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1789672684.094756:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672684.104860:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672684.104950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543340416 00000100:00100000:3.0:1789672684.104964:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543340416 00000100:00100000:3.0:1789672684.105043:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 131 00000100:00100000:3.0:1789672684.105057:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+21:10556:x1876607543340416:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672684.105088:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672684.105115:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09107 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9a5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672684.105250:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0910e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672684.105269:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0910e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672684.105284:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0910e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672684.105298:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789672684.105472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09107 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9a5 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672684.105493:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0910e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9a5 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672684.105519:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:3.0:1789672684.105522:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672684.105527:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672684.106370:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+23:10556:x1876607543340416:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1311us (1586us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789672684.106383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 131 00000100:00100000:0.0:1789672684.116138:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672684.116194:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543340544 00000100:00100000:0.0:1789672684.116208:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543340544 00000100:00100000:0.0:1789672684.116308:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:0.0:1789672684.116322:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+23:2357:x1876607543340544:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672684.116345:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672684.116376:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0910e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9a5 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.116408:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672684.116415:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672684.116490:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+22:2357:x1876607543340544:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672684.116498:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:1.0:1789672684.124105:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672684.139509:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543340800 00000100:00100000:2.0:1789672684.139532:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543340800 00000100:00100000:2.0:1789672684.139628:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 132 00000100:00100000:2.0:1789672684.139640:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+22:10556:x1876607543340800:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789672684.139756:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.139780:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.139823:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140084:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140094:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140102:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140127:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672684.140132:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140142:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140158:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:2.0:1789672684.140162:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672684.140168:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672684.140175:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0911c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672684.140397:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+23:10556:x1876607543340800:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 757us (16306us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789672684.140407:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 132 00000040:00080000:2.0:1789672684.140584:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672684.140590:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672684.142400:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789672684.142426:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789672684.149553:0:12103:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672684.149565:0:12103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672684.149617:0:12103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789672684.149624:0:12103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672684.155385:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672684.155616:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341056 00000100:00100000:2.0:1789672684.155629:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341056 00000100:00100000:2.0:1789672684.155703:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:2.0:1789672684.155716:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+23:10556:x1876607543341056:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789672684.157875:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+24:10556:x1876607543341056:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 2143us (2488us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789672684.157909:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:0.0:1789672684.376981:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672684.378229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341312 00000100:00100000:1.0:1789672684.378249:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341312 00000100:00100000:1.0:1789672684.378336:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 133 00000100:00100000:1.0:1789672684.378361:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+24:10570:x1876607543341312:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672684.378404:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672684.378432:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09123 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9ac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672684.378696:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0912a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672684.378716:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0912a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672684.378734:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0912a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672684.378749:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789672684.379021:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9ac expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672684.379041:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0912a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9ac expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672684.379052:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:1.0:1789672684.379056:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789672684.379061:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f600, rc 0) 00000100:00100000:1.0:1789672684.380017:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+26:10570:x1876607543341312:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1650us (3052us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789672684.380030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 133 00000100:00100000:3.0:1789672684.383778:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672684.383889:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341440 00000100:00100000:0.0:1789672684.383904:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341440 00000100:00100000:0.0:1789672684.384025:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 134 00000100:00100000:0.0:1789672684.384039:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+26:10570:x1876607543341440:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:0.0:1789672684.384406:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384428:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384445:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384482:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384491:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384498:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384506:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672684.384530:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384540:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384556:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672684.384570:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672684.384577:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.384585:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910000/0x2247cb9491d09138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672684.384687:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+26:10570:x1876607543341440:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 650us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672684.384695:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 134 00000100:00100000:3.0:1789672684.467421:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564320128:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.467518:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.467579:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564320640:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.467610:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.467642:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672684.467648:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564320512:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.467676:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.467708:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564320256:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.467732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.467749:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564320768:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.467769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.467817:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672684.467824:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564320384:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.467849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.467890:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320128 00000100:00100000:3.0:1789672684.467900:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320128 00000100:00100000:3.0:1789672684.467962:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789672684.467988:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564320128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468051:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564320128:12345-0@lo:400:kworker.0 Request processed in 64us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.468058:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789672684.468098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320640 00000100:00100000:3.0:1789672684.468103:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320640 00000100:00100000:3.0:1789672684.468139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320256 00000100:00100000:3.0:1789672684.468143:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320256 00000100:00100000:3.0:1789672684.468157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320384 00000100:00100000:3.0:1789672684.468159:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320384 00000100:00100000:3.0:1789672684.468175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789672684.468181:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564320640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468216:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564320640:12345-0@lo:400:kworker.0 Request processed in 35us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.468223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789672684.468236:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789672684.468242:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564320256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468273:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564320256:12345-0@lo:400:kworker.0 Request processed in 31us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.468279:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789672684.468292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789672684.468298:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564320384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468326:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564320384:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.468332:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789672684.468353:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320512 00000100:00100000:3.0:1789672684.468357:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320512 00000100:00100000:3.0:1789672684.468392:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320768 00000100:00100000:3.0:1789672684.468396:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320768 00000100:00100000:3.0:1789672684.468418:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789672684.468424:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876607564320512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468455:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876607564320512:12345-0@lo:400:kworker.0 Request processed in 32us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.468460:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789672684.468471:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789672684.468477:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564320768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468506:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564320768:12345-0@lo:400:kworker.0 Request processed in 30us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.468512:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789672684.468580:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564320384:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468593:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564320256:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468602:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564320768:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468644:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564320512:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468652:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564320128:0@lo:400:kworker.0 00000100:00100000:3.0:1789672684.468661:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564320640:0@lo:400:kworker.0 00000100:00080000:2.0:1789672684.471994:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672684.472009:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672684.472013:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672684.489674:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672684.489714:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa61183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564320896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672684.489842:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672684.489908:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564320896 00000100:00100000:3.0:1789672684.489917:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564320896 00000100:00100000:3.0:1789672684.489972:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789672684.489990:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564320896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672684.490042:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672684.490100:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564320896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672684.490109:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789672684.492189:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa61183b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564320896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672684.518863:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672684.518946:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341568 00000100:00100000:0.0:1789672684.518961:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341568 00000100:00100000:0.0:1789672684.519042:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:0.0:1789672684.519054:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543341568:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:0.0:1789672684.519076:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672684.519105:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b620ef5/0x2247cb9491d0913f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9b3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672684.519220:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aac3cea, atime: 0x6aac3cea, ctime: 0x6aac3cea, blocks: 0xb 00010000:00010000:0.0:1789672684.519250:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789672684.519255:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672684.519266:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b620ef5/0x2247cb9491d0913f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9b3 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.519300:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b620ef5/0x2247cb9491d0913f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9b3 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672684.519317:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910000, rc 0) 00000100:00100000:0.0:1789672684.519390:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543341568:12345-192.168.202.39@tcp:101:cat.0 Request processed in 338us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672684.519397:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00080000:0.0:1789672684.519425:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672684.554264:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672684.556862:0:11985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341696 00000100:00100000:3.0:1789672684.556885:0:11985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341696 00002000:00100000:3.0:1789672684.556962:0:11985:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fa62f796680 x1876607543341696/t0(0) o3->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:310/0 lens 488/0 e 0 to 0 dl 1789672695 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672684.556975:0:11985:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa62f796680 with x1876607543341696 ext(0->4095) 00002000:00010000:3.0:1789672684.556982:0:11985:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa62f796680 00000100:00100000:3.0:1789672684.557021:0:11985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:3.0:1789672684.557032:0:11985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7225c799-181e-4570-897c-b66842e45960+7:2360:x1876607543341696:12345-192.168.202.39@tcp:3:cat.0 00000100:00100000:3.0:1789672684.557343:0:11985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7225c799-181e-4570-897c-b66842e45960+7:2360:x1876607543341696:12345-192.168.202.39@tcp:3:cat.0 Request processed in 311us (3093us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789672684.557352:0:11985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 3 00002000:00100000:3.0:1789672684.557360:0:11985:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fa62f796680 x1876607543341696/t0(0) o3->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:310/0 lens 488/4536 e 0 to 0 dl 1789672695 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672684.557368:0:11985:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa62f796680 with x1876607543341696 ext(0->4095) 00002000:00010000:3.0:1789672684.557372:0:11985:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa62f796680 00010000:00010000:3.0:1789672684.787569:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672685.814474:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789672686.089372:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789672686.089404:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1789672686.256638:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672686.257083:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672686.257129:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672686.257151:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672686.257178:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672686.257247:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342208 00000100:00100000:1.0:1789672686.257261:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342208 00000100:00100000:1.0:1789672686.257338:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342080 00000100:00100000:1.0:1789672686.257341:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342080 00000100:00100000:1.0:1789672686.257371:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:1.0:1789672686.257382:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2360:x1876607543342208:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672686.257491:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2360:x1876607543342208:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672686.257499:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:1.0:1789672686.257521:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:1.0:1789672686.257529:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543342080:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672686.257556:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543342080:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672686.257563:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:1.0:1789672686.257586:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341824 00000100:00100000:1.0:1789672686.257589:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341824 00000100:00100000:1.0:1789672686.257617:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 287 00000100:00100000:1.0:1789672686.257624:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543341824:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672686.257649:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543341824:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672686.257655:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 287 00000100:00080000:1.0:1789672686.257684:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672686.257688:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672686.271547:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543341952 00000100:00100000:3.0:1789672686.271569:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543341952 00000100:00100000:3.0:1789672686.271676:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342336 00000100:00100000:3.0:1789672686.271696:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342336 00000100:00100000:3.0:1789672686.271741:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 137 00000100:00100000:3.0:1789672686.271753:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:2360:x1876607543341952:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672686.271910:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:2360:x1876607543341952:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 159us (15286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672686.271918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 137 00000100:00100000:3.0:1789672686.271942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 138 00000100:00100000:3.0:1789672686.271949:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543342336:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672686.271982:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2360:x1876607543342336:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 33us (14803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672686.271988:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 138 00000100:00080000:3.0:1789672686.272016:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789672686.839512:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672687.539222:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672687.539259:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564321024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672687.539376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672687.539573:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321024 00000100:00100000:2.0:1789672687.539587:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321024 00000100:00100000:2.0:1789672687.539675:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789672687.539689:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564321024:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789672687.539691:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789672687.539741:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672687.539855:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564321024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672687.539863:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672687.540019:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789672687.540028:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789672687.540059:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa611838e00, transno 4294967304 00000100:00100000:1.0:1789672687.540089:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564321024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672687.860089:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789672688.168245:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1789672688.168275:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789672688.174497:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789672688.174524:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa611d3de40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789672688.174530:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa604a45b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa611d3dc00 00000020:00080000:1.0:1789672688.174535:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa604a45f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa63a278000 00000020:00080000:1.0:1789672688.174594:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789672688.174753:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789672688.175086:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1789672688.251303:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672688.251315:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672688.251366:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789672688.251374:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789672688.883285:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672689.588126:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672689.588160:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564321152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672689.588268:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.588356:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321152 00000100:00100000:2.0:1789672689.588367:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321152 00000100:00100000:2.0:1789672689.588451:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789672689.588463:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564321152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672689.588510:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672689.588566:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564321152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.588575:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789672689.588601:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672689.588660:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789672689.588667:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789672689.588704:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564321152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672689.589002:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564321408:0@lo:400:kworker.0 00000100:00100000:0.0:1789672689.589045:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672689.589068:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789672689.589074:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564321280:0@lo:400:kworker.0 00000100:00100000:0.0:1789672689.589105:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672689.589128:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564321792:0@lo:400:kworker.0 00000100:00100000:0.0:1789672689.589162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.589496:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564321664:0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.589536:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.589561:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672689.589567:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564321536:0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.589591:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.589626:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321408 00000100:00100000:3.0:1789672689.589631:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321408 00000100:00100000:3.0:1789672689.589672:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321792 00000100:00100000:3.0:1789672689.589675:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321792 00000100:00100000:3.0:1789672689.589695:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321536 00000100:00100000:3.0:1789672689.589705:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321536 00000100:00100000:3.0:1789672689.589726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789672689.589745:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564321408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.589816:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564321408:12345-0@lo:400:kworker.0 Request processed in 83us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672689.589823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789672689.589842:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789672689.589848:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564321792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.589875:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564321792:12345-0@lo:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672689.589881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789672689.589892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789672689.589898:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564321536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.589946:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564321536:12345-0@lo:400:kworker.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672689.589952:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789672689.589972:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321280 00000100:00100000:3.0:1789672689.589976:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321280 00000100:00100000:3.0:1789672689.590002:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789672689.590008:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564321280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.590040:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564321280:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672689.590047:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789672689.590122:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564321536:0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.590148:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564321280:0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.590170:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564321792:0@lo:400:kworker.0 00000100:00100000:3.0:1789672689.590179:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564321408:0@lo:400:kworker.0 00000100:00080000:2.0:1789672689.590347:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672689.590470:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321664 00000100:00100000:0.0:1789672689.590475:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321664 00000100:00100000:0.0:1789672689.590535:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789672689.590547:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564321664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672689.590589:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564321664:12345-0@lo:400:kworker.0 Request processed in 46us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.590595:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789672689.590653:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672689.590856:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564321664:0@lo:400:kworker.0 00010000:00010000:0.0:1789672689.907130:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672690.690317:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672690.690493:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342464 00000100:00100000:3.0:1789672690.690508:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342464 00000100:00100000:3.0:1789672690.690608:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 135 00000100:00100000:3.0:1789672690.690624:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+13:10222:x1876607543342464:12345-192.168.202.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789672690.690776:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+13:10222:x1876607543342464:12345-192.168.202.39@tcp:60:lhsmtool_posix.0 Request processed in 157us (473us total) trans 0 rc 0/0 00000100:00080000:2.0:1789672690.690844:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672690.691931:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 135 00000100:00100000:3.0:1789672690.693350:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672690.693454:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342720 00000100:00100000:2.0:1789672690.693467:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342720 00000100:00100000:2.0:1789672690.693904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:2.0:1789672690.693918:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+13:10222:x1876607543342720:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789672690.694400:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+14:10222:x1876607543342720:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 484us (1057us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789672690.694408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00010000:00010000:3.0:1789672690.935638:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672691.371544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672691.371609:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672691.371640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672691.371701:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672691.371902:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342976 00000100:00100000:3.0:1789672691.371916:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342976 00000100:00100000:2.0:1789672691.371934:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543343104 00000100:00100000:2.0:1789672691.371942:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543343104 00000100:00100000:3.0:1789672691.371999:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543343360 00000100:00100000:3.0:1789672691.372006:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543343360 00000100:00100000:2.0:1789672691.372021:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 72 00000100:00100000:2.0:1789672691.372037:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543343104:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672691.372109:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 142 00000100:00100000:3.0:1789672691.372122:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:2358:x1876607543342976:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672691.372144:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543343104:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 110us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672691.372153:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 72 00000100:00100000:2.0:1789672691.372214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 143 00000100:00100000:2.0:1789672691.372223:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543343360:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672691.372246:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:2358:x1876607543342976:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 127us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672691.372255:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 142 00000100:00100000:2.0:1789672691.372260:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543343360:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 36us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672691.372269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 143 00000100:00100000:1.0:1789672691.372415:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543342848 00000100:00100000:1.0:1789672691.372421:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543342848 00000100:00100000:1.0:1789672691.372470:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 289 00000100:00100000:1.0:1789672691.372477:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543342848:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672691.372511:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543342848:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 34us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672691.372517:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 289 00000100:00080000:0.0:1789672691.372654:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672691.372660:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672691.384157:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672691.393474:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543343232 00000100:00100000:0.0:1789672691.393498:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543343232 00000100:00100000:0.0:1789672691.393673:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00100000:0.0:1789672691.393689:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543343232:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672691.393836:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543343232:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 153us (9694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672691.393845:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00080000:1.0:1789672691.393910:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789672691.955216:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672692.665382:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564321920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672692.665481:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672692.665576:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564321920 00000100:00100000:2.0:1789672692.665586:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564321920 00000100:00100000:2.0:1789672692.665662:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789672692.665673:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564321920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672692.665732:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672692.665805:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564321920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672692.665812:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789672692.665837:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672692.665897:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564321920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672692.988412:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672693.257338:0:12305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:18:11 (1789672691) 00000020:00080000:1.0:1789672693.261565:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1789672693.261609:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789672693.261852:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789672693.261866:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789672694.006853:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672694.707119:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672694.707170:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564322048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672694.707270:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672694.707840:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564322048 00000100:00100000:2.0:1789672694.707852:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564322048 00000100:00100000:2.0:1789672694.707942:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789672694.707954:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564322048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672694.708001:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672694.708072:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564322048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672694.708079:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789672694.708134:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564322048:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789672694.708219:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672694.708636:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564322304:0@lo:400:kworker.0 00000100:00100000:1.0:1789672694.708679:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672694.708724:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672694.708730:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564322432:0@lo:400:kworker.0 00000100:00100000:1.0:1789672694.708765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672694.708865:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564322304 00000100:00100000:3.0:1789672694.708872:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564322304 00000100:00100000:3.0:1789672694.708919:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564322432 00000100:00100000:3.0:1789672694.708922:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564322432 00000100:00100000:3.0:1789672694.708952:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789672694.708959:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564322304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672694.709014:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564322304:12345-0@lo:400:kworker.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672694.709021:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789672694.709036:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789672694.709042:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564322432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672694.709068:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564322432:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672694.709073:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1789672694.709092:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672694.709375:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564322560:0@lo:400:kworker.0 00000100:00100000:0.0:1789672694.709415:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672694.709449:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789672694.709456:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564322176:0@lo:400:kworker.0 00000100:00100000:0.0:1789672694.709502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672694.709537:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564322688:0@lo:400:kworker.0 00000100:00100000:0.0:1789672694.709561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672694.709592:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564322176 00000100:00100000:0.0:1789672694.709597:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564322176 00000100:00100000:0.0:1789672694.709636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789672694.709643:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564322176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672694.709678:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564322176:12345-0@lo:400:kworker.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672694.709695:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789672694.709731:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564322688 00000100:00100000:0.0:1789672694.709735:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564322688 00000100:00100000:0.0:1789672694.709766:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789672694.709772:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564322688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672694.709829:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564322688:12345-0@lo:400:kworker.0 Request processed in 57us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672694.709834:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1789672694.709850:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672694.709874:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564322176:0@lo:400:kworker.0 00000100:00100000:0.0:1789672694.709886:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564322688:0@lo:400:kworker.0 00000100:00100000:1.0:1789672694.709991:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564322432:0@lo:400:kworker.0 00000100:00100000:1.0:1789672694.710015:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564322304:0@lo:400:kworker.0 00000100:00100000:3.0:1789672694.710531:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564322560 00000100:00100000:3.0:1789672694.710538:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564322560 00000100:00100000:3.0:1789672694.710814:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672694.710823:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564322560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672694.710895:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564322560:12345-0@lo:400:kworker.0 Request processed in 74us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672694.710902:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789672694.710969:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564322560:0@lo:400:kworker.0 00000100:00080000:1.0:1789672694.713865:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672694.763008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672694.763093:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543343616 00000100:00100000:0.0:1789672694.763107:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543343616 00000100:00100000:0.0:1789672694.763214:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 136 00000100:00100000:0.0:1789672694.763237:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+13:11283:x1876607543343616:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672694.763285:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672694.763315:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09146 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9ba expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.763426:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.763443:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.763459:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789672694.763776:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789672694.763865:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.763875:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.763883:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764206:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0915b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764216:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0915b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764223:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0915b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672694.764235:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789672694.764461:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764524:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764533:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764539:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672694.764544:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764553:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764567:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa6184b6800) 00010000:00010000:0.0:1789672694.764571:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672694.764576:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764583:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d0914d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764596:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764602:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764608:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764623:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672694.764626:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764633:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764640:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa610c05c00) 00010000:00010000:0.0:1789672694.764642:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672694.764645:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.764650:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09154 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.765918:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09146 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9ba expref: 16 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.765946:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0915b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9ba expref: 15 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672694.765955:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672694.765958:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672694.765961:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911600, rc 0) 00000100:00100000:0.0:1789672694.766063:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+15:11283:x1876607543343616:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 2837us (3071us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789672694.766074:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 136 00000100:00100000:1.0:1789672694.776775:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672694.776878:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672694.776894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543343744 00000100:00100000:2.0:1789672694.776908:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543343744 00000100:00100000:2.0:1789672694.777060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 137 00000100:00100000:3.0:1789672694.777065:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543343872 00000100:00100000:3.0:1789672694.777070:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543343872 00000100:00100000:2.0:1789672694.777072:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+15:11283:x1876607543343744:12345-192.168.202.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789672694.777123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:3.0:1789672694.777138:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+16:2358:x1876607543343872:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672694.777150:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672694.777190:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d0915b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9ba expref: 16 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672694.777206:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+15:11283:x1876607543343744:12345-192.168.202.39@tcp:59:lhsmtool_posix.0 Request processed in 137us (446us total) trans 0 rc 0/0 00010000:00010000:3.0:1789672694.777213:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00000100:00100000:2.0:1789672694.777213:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 137 00010000:00010000:3.0:1789672694.777219:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672694.777241:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+14:2358:x1876607543343872:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 104us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672694.777248:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00010000:00010000:0.0:1789672695.027040:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789672695.412165:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672695.412179:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672695.412672:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789672695.412718:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789672696.050999:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672696.490322:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672696.490438:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672696.490532:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672696.490571:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672696.490677:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672696.490741:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344384 00000100:00100000:1.0:1789672696.490754:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344384 00000100:00100000:1.0:1789672696.490865:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344256 00000100:00100000:1.0:1789672696.490868:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344256 00000100:00100000:1.0:1789672696.490898:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:1.0:1789672696.490911:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543344384:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672696.491009:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543344384:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 99us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672696.491018:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:1.0:1789672696.491038:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:1.0:1789672696.491045:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543344256:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672696.491072:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543344256:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672696.491078:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:2.0:1789672696.491562:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344000 00000100:00100000:2.0:1789672696.491570:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344000 00000100:00100000:2.0:1789672696.491615:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 291 00000100:00100000:2.0:1789672696.491622:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543344000:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672696.491683:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543344000:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 61us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672696.491689:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 291 00000100:00080000:2.0:1789672696.491721:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672696.491726:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672696.495430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344128 00000100:00100000:0.0:1789672696.495452:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344128 00000100:00100000:0.0:1789672696.495604:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344512 00000100:00100000:0.0:1789672696.495609:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344512 00000100:00100000:1.0:1789672696.495694:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 147 00000100:00100000:1.0:1789672696.495719:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:2357:x1876607543344128:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672696.495853:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:2357:x1876607543344128:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 137us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672696.495885:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 147 00000100:00080000:2.0:1789672696.497364:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672696.498987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 148 00000100:00100000:0.0:1789672696.499006:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543344512:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672696.499125:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2358:x1876607543344512:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 124us (8456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672696.499134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 148 00000100:00100000:2.0:1789672696.929472:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672696.929650:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344640 00000100:00100000:0.0:1789672696.929673:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344640 00000100:00100000:0.0:1789672696.929751:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 138 00000100:00100000:0.0:1789672696.929765:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:11325:x1876607543344640:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672696.929849:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672696.929876:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9c1 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.929966:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930005:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930022:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930040:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930046:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930063:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930322:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930331:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930339:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930345:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672696.930351:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930360:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930374:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672696.930378:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672696.930384:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930391:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930402:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930409:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930421:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930426:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672696.930429:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930435:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930443:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa610c05500) 00010000:00010000:0.0:1789672696.930445:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672696.930449:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930455:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09177 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930492:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09169 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9c1 expref: 15 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930504:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672696.930506:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672696.930510:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9c1 expref: 15 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.930520:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910c00, rc 0) 00000100:00100000:0.0:1789672696.930727:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:11325:x1876607543344640:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 963us (1269us total) trans 0 rc 301/301 00000100:00100000:0.0:1789672696.930746:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 138 00000100:00100000:3.0:1789672696.942007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672696.942221:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543344896 00000100:00100000:1.0:1789672696.942234:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543344896 00000100:00100000:1.0:1789672696.942302:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 139 00000100:00100000:1.0:1789672696.942314:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+14:11325:x1876607543344896:12345-192.168.202.39@tcp:36:lfs.0 00010000:00010000:1.0:1789672696.942391:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672696.942425:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d08af5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf801 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.942446:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:1.0:1789672696.942459:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672696.943019:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.943040:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.943056:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.943073:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.943504:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.943512:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672696.950118:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789672696.950153:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.950166:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.950176:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.950183:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672696.950188:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.950197:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.950218:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6c00) 00010000:00010000:1.0:1789672696.950222:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672696.950228:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.950235:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0917e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672696.950258:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a05d357 reply state 00000000be4eaaf9 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672696.950270:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672696.950403:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+15:11325:x1876607543344896:12345-192.168.202.39@tcp:36:lfs.0 Request processed in 8085us (8405us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789672696.950413:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 139 00010000:00010000:3.0:1789672696.952613:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672696.952632:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672696.952765:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672696.952851:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672696.952859:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672696.952868:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672696.952886:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa6184b6600) 00010000:00010000:3.0:1789672696.952890:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672696.952895:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672696.952901:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09185 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.080828:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672697.102636:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.102725:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543345024 00000100:00100000:0.0:1789672697.102739:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543345024 00000100:00100000:0.0:1789672697.102876:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 140 00000100:00100000:0.0:1789672697.102886:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+14:11333:x1876607543345024:12345-192.168.202.39@tcp:101:lctl.0 00010000:00010000:0.0:1789672697.102916:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672697.102943:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0918c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9c8 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.103035:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.103054:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.103068:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672697.103117:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789672697.103122:0:7918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672697.103151:0:7918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.103182:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0918c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9c8 expref: 16 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.103203:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9c8 expref: 15 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.103235:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672697.103238:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672697.103243:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911800, rc 0) 00000100:00100000:0.0:1789672697.103312:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+15:11333:x1876607543345024:12345-192.168.202.39@tcp:101:lctl.0 Request processed in 426us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672697.103320:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 140 00000100:00100000:2.0:1789672697.191468:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672697.191880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543345152 00000100:00100000:1.0:1789672697.191914:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543345152 00000100:00100000:1.0:1789672697.191985:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 141 00000100:00100000:1.0:1789672697.191997:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+15:11339:x1876607543345152:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:1.0:1789672697.192027:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672697.192058:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0919a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192406:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192426:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192440:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192458:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192464:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192472:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192772:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d091af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192782:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d091af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192830:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d091af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672697.192877:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789672697.192881:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672697.192906:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d091af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192923:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192931:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192941:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192948:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672697.192953:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192962:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192977:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:1.0:1789672697.192980:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672697.192986:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.192993:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d091a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193011:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193028:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193034:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193039:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672697.193043:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193049:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193056:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa6184b6c00) 00010000:00010000:1.0:1789672697.193058:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672697.193061:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193066:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d091a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193432:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d0919a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9cf expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193455:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d091af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9cf expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.193467:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:1.0:1789672697.193470:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789672697.193495:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f200, rc 0) 00000100:00100000:2.0:1789672697.194358:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+16:11339:x1876607543345152:12345-192.168.202.39@tcp:101:bash.0 Request processed in 2354us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672697.194371:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 141 00000100:00100000:2.0:1789672697.201330:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.201894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543345408 00000100:00100000:3.0:1789672697.201926:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543345408 00000100:00100000:3.0:1789672697.202020:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 142 00000100:00100000:3.0:1789672697.202039:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+16:11339:x1876607543345408:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672697.202103:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672697.202306:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d091b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9d6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.203990:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.204022:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.204059:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.213177:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.213202:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.213215:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672697.214221:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789672697.214399:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214412:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214422:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214459:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214466:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214473:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214480:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672697.214491:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214499:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214511:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672697.214514:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672697.214519:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214524:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d091bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672697.214538:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000893653ac reply state 0000000098aca7b3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.214548:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789672697.214590:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d091b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214604:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.214612:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:3.0:1789672697.214614:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672697.214617:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ca00, rc 0) 00000100:00100000:3.0:1789672697.214715:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+19:11339:x1876607543345408:12345-192.168.202.39@tcp:101:bash.0 Request processed in 12681us (13399us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789672697.214725:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 142 00000100:00100000:3.0:1789672697.218482:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672697.218595:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543345536 00000100:00100000:1.0:1789672697.218613:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543345536 00000100:00100000:1.0:1789672697.218710:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:1.0:1789672697.218723:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2360:x1876607543345536:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:1.0:1789672697.218749:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672697.218779:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9dd expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672697.218842:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789672697.218873:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789672697.218879:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672697.218892:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.218914:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.218929:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672697.219010:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2360:x1876607543345536:12345-192.168.202.39@tcp:101:bash.0 Request processed in 290us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672697.219018:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 47 00010000:00010000:2.0:1789672697.219895:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.219911:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.219939:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.219946:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672697.219951:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.219959:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.219977:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa611330a00) 00010000:00010000:2.0:1789672697.219980:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672697.219985:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.219992:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d091c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.221401:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672697.221472:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543345664 00000100:00100000:2.0:1789672697.221482:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543345664 00000100:00100000:2.0:1789672697.221536:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:2.0:1789672697.221544:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+6:11339:x1876607543345664:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672697.221561:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672697.221577:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9e4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.221637:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.221675:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789672697.221681:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672697.221689:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.221725:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.221739:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672697.221755:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876607564322816:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672697.221867:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa641b64780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672697.224495:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672697.225095:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876607564322816:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672697.225146:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.225202:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fe00, rc 0) 00000100:00100000:1.0:1789672697.225287:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+7:11339:x1876607543345664:12345-192.168.202.39@tcp:101:bash.0 Request processed in 3742us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672697.225298:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:1.0:1789672697.227974:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543345792 00000100:00100000:1.0:1789672697.228161:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543345792 00010000:00010000:1.0:1789672697.228243:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672697.228317:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00100000:1.0:1789672697.228330:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543345792:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672697.228350:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672697.228382:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.228399:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.228433:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbcf54d0/0x2247cb9491d091d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9dd expref: 7 pid: 6685 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.228455:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672697.228460:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672697.228471:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.228736:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672697.228905:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672697.228923:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1876607564322944:192.168.202.39@tcp:105: 00000100:00100000:1.0:1789672697.229320:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672697.232085:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5816:1876607564322944:192.168.202.39@tcp:105: 00010000:00010000:1.0:1789672697.232131:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672697.232231:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543345792:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 3902us (7744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672697.232247:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00100000:3.0:1789672697.234275:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672697.238768:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543346048 00000100:00100000:1.0:1789672697.238805:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543346048 00000100:00100000:1.0:1789672697.238909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:1.0:1789672697.238922:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+18:11339:x1876607543346048:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:1.0:1789672697.239415:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+19:11339:x1876607543346048:12345-192.168.202.39@tcp:35:bash.0 Request processed in 495us (5148us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789672697.239424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:3.0:1789672697.346464:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.346683:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543346304 00000100:00100000:0.0:1789672697.346698:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543346304 00000100:00100000:0.0:1789672697.346885:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 143 00000100:00100000:0.0:1789672697.346899:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+19:11349:x1876607543346304:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672697.346932:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672697.346962:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d091e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9eb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672697.347099:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789672697.347262:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d091e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9eb expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.347280:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672697.347283:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672697.347289:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d091e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9eb expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.347306:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910800, rc 0) 00000100:00100000:0.0:1789672697.347392:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+20:11349:x1876607543346304:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 496us (955us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1789672697.347422:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 143 00000100:00100000:3.0:1789672697.351776:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672697.351907:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543346560 00000100:00100000:1.0:1789672697.351920:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543346560 00000100:00100000:1.0:1789672697.352005:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:1.0:1789672697.352017:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+20:11349:x1876607543346560:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672697.352360:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+21:11349:x1876607543346560:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 345us (655us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789672697.352369:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:2.0:1789672697.450909:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.451037:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543346688 00000100:00100000:0.0:1789672697.451053:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543346688 00000100:00100000:0.0:1789672697.451131:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 144 00000100:00100000:0.0:1789672697.451143:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+21:11355:x1876607543346688:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672697.451176:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672697.451205:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d091f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9f2 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.451298:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d091fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.451317:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d091fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.451332:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d091fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672697.451519:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789672697.451525:0:7918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672697.451548:0:7918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d091fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.451582:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d091f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9f2 expref: 23 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.451606:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d091fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9f2 expref: 22 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.451643:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672697.451647:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672697.451652:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910c00, rc 0) 00000100:00100000:0.0:1789672697.451922:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+22:11355:x1876607543346688:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 781us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672697.451932:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 144 00000100:00100000:3.0:1789672697.455627:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672697.456213:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543346944 00000100:00100000:2.0:1789672697.456227:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543346944 00000100:00100000:2.0:1789672697.456304:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 145 00000100:00100000:2.0:1789672697.456317:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+22:11355:x1876607543346944:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672697.456358:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672697.456389:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bf9f9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.456527:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d0920a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.456566:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d0920a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.456582:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d0920a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672697.456597:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789672697.456818:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9f9 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.456841:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d0920a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9f9 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.456852:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:2.0:1789672697.456855:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672697.456860:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ea00, rc 0) 00000100:00100000:2.0:1789672697.456951:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+24:11355:x1876607543346944:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 637us (1335us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789672697.456961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 145 00000100:00100000:2.0:1789672697.463726:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.463844:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543347328 00000100:00100000:3.0:1789672697.463859:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543347328 00000100:00100000:3.0:1789672697.463952:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:3.0:1789672697.463963:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+24:2359:x1876607543347328:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672697.463983:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672697.464015:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d0920a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9f9 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.464051:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:3.0:1789672697.464058:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672697.464258:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+23:2359:x1876607543347328:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 294us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672697.464267:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:3.0:1789672697.467713:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672697.468291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543347200 00000100:00100000:2.0:1789672697.468307:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543347200 00000100:00100000:2.0:1789672697.468395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 146 00000100:00100000:2.0:1789672697.468407:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+23:11355:x1876607543347200:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672697.468452:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672697.468482:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d09218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.468649:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0921f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.468685:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0921f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.468700:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0921f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672697.468727:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789672697.468959:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d09218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa00 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.470499:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0921f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa00 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.470519:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:2.0:1789672697.470522:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789672697.470528:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fc00, rc 0) 00000100:00100000:2.0:1789672697.470651:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+25:11355:x1876607543347200:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 2244us (2952us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789672697.470675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 146 00000100:00100000:2.0:1789672697.484947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.485422:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543347456 00000100:00100000:3.0:1789672697.485449:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543347456 00000100:00100000:3.0:1789672697.485540:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:3.0:1789672697.485558:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543347456:12345-192.168.202.39@tcp:1:lfs.0 00010000:00010000:3.0:1789672697.485622:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.485684:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.485694:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672697.485700:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672697.485705:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.485758:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.485774:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 6 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.485842:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f6a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876607564323072:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672697.486156:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e76240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672697.496340:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.496457:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543347584 00000100:00100000:0.0:1789672697.496470:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543347584 00002000:00100000:0.0:1789672697.496540:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fa604a0c700 x1876607543347584/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:323/0 lens 504/0 e 0 to 0 dl 1789672708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672697.496553:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa604a0c700 with x1876607543347584 ext(0->12) 00010000:00010000:0.0:1789672697.496565:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 7 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.496584:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 7 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672697.496594:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa604a0c700 00000100:00100000:0.0:1789672697.496639:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:0.0:1789672697.496651:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543347584:12345-192.168.202.39@tcp:4:lfs.0 00000100:00100000:0.0:1789672697.497391:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+9:2358:x1876607543347584:12345-192.168.202.39@tcp:4:lfs.0 Request processed in 737us (1060us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789672697.497401:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00002000:00100000:0.0:1789672697.497411:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fa604a0c700 x1876607543347584/t4294967305(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:323/0 lens 504/448 e 0 to 0 dl 1789672708 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672697.497427:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa604a0c700 with x1876607543347584 ext(0->12) 00010000:00010000:0.0:1789672697.497435:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 9 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.497448:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 9 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672697.497454:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa604a0c700 00000100:00100000:3.0:1789672697.499087:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f6a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876607564323072:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672697.499130:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672697.499909:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.500175:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543347712 00000100:00100000:0.0:1789672697.500186:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543347712 00010000:00010000:0.0:1789672697.500234:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 9 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672697.500336:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:0.0:1789672697.500348:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+9:2357:x1876607543347712:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672697.500366:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789672697.500390:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789672697.500393:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789672697 00002000:00010000:0.0:1789672697.500396:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789672698 00002000:00010000:0.0:1789672697.500398:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789672697 00010000:00010000:0.0:1789672697.500404:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 9 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.500419:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 9 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.500487:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011238a94/0x2247cb9491d091e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9e4 expref: 9 pid: 6682 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.500523:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672697.500528:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672697.500535:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.500546:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.500585:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672697.500671:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543347712:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 324us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672697.500680:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 63 00010000:00010000:3.0:1789672697.501710:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501731:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501831:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501847:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501857:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501865:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67cc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672697.501871:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501881:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501900:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.501909:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b953857/0x2247cb9491d0922d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.502009:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543347456:12345-192.168.202.39@tcp:1:lfs.0 Request processed in 16451us (17074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672697.502021:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:2.0:1789672697.511073:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.511500:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543347968 00000100:00100000:3.0:1789672697.511516:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543347968 00000100:00100000:3.0:1789672697.511598:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:3.0:1789672697.511611:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+25:11355:x1876607543347968:12345-192.168.202.39@tcp:35:lfs.0 00000004:00010000:3.0:1789672697.511715:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0921f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa00 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672697.512526:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789672697.512586:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789672697.516019:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789672697.516911:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.516947:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.516959:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.517015:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.517546:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 29 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672697.517567:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876607564323200:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672697.517779:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63518c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789672697.532410:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.532559:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543348096 00000100:00100000:3.0:1789672697.532572:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543348096 00010000:00010000:3.0:1789672697.532630:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 30 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.532694:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:3.0:1789672697.532707:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+30:2358:x1876607543348096:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672697.532726:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672697.532735:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 30 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.532750:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 30 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.532778:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:3.0:1789672697.532808:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.532847:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.532855:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.532882:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672697.532961:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+30:2358:x1876607543348096:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 258us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672697.532969:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 64 00010000:00010000:0.0:1789672697.533733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d091cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9d6 expref: 29 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672697.533758:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1876607564323200:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672697.533824:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.533843:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.533851:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672697.534038:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789672697.534293:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789672697.534431:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564323328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789672697.535016:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672697.535354:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63518c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672697.535609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564323328 00000100:00100000:3.0:1789672697.535621:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564323328 00000100:00100000:3.0:1789672697.535731:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789672697.535743:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876607564323328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789672697.535900:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876607564323328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672697.535908:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789672697.535957:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564323328:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1789672697.536552:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789672697.537345:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789672697.538265:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f6a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564323456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789672697.538363:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672697.538465:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e76e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672697.542479:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564323456 00000100:00100000:1.0:1789672697.542502:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564323456 00000100:00100000:1.0:1789672697.542592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672697.542605:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1876607564323456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789672697.543045:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1876607564323456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 441us (4680us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789672697.543055:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789672697.543446:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f6a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1876607564323456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789672697.543550:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789672697.543614:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.543652:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.543671:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.543677:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672697.543683:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.543692:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.543713:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:3.0:1789672697.543716:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789672697.543722:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.543729:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d09234 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672697.544185:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789672697.544320:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789672697.544335:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366325547962ns, next at 367325545498ns, rc = 0 00000001:00080000:3.0:1789672697.544342:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789672697.544383:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330c00) 00010000:00010000:3.0:1789672697.544386:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789672697.544396:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0921f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa00 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.544566:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+32:11355:x1876607543347968:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 32957us (33509us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789672697.544576:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 38 00000020:00080000:3.0:1789672697.544583:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789672697.547256:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.548001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543348224 00000100:00100000:0.0:1789672697.548016:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543348224 00000100:00100000:0.0:1789672697.548115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 147 00000100:00100000:0.0:1789672697.548147:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+32:11355:x1876607543348224:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672697.548185:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672697.548216:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d0923b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa07 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.548299:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d0923b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa07 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.548316:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d0923b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa07 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.548342:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672697.548346:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672697.548350:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911e00, rc 0) 00000100:00100000:0.0:1789672697.548448:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+33:11355:x1876607543348224:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 303us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672697.548456:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 147 00000100:00100000:2.0:1789672697.553826:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.554109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543348480 00000100:00100000:3.0:1789672697.554123:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543348480 00000100:00100000:3.0:1789672697.554202:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:3.0:1789672697.554215:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+33:11355:x1876607543348480:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:3.0:1789672697.554561:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+34:11355:x1876607543348480:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 347us (783us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789672697.554570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:3.0:1789672697.684908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672697.685220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543348736 00000100:00100000:2.0:1789672697.685235:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543348736 00000100:00100000:2.0:1789672697.685308:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 148 00000100:00100000:2.0:1789672697.685319:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+34:11365:x1876607543348736:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672697.685355:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672697.685384:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09242 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672697.685515:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789672697.685700:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09242 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa0e expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.685717:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:2.0:1789672697.685721:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672697.685728:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa0e expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.685746:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929ec00, rc 0) 00000100:00100000:2.0:1789672697.685889:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+35:11365:x1876607543348736:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 572us (997us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789672697.685899:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 148 00000100:00100000:2.0:1789672697.695333:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.695439:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543348864 00000100:00100000:0.0:1789672697.695452:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543348864 00000100:00100000:0.0:1789672697.695521:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 149 00000100:00100000:0.0:1789672697.695533:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+35:11365:x1876607543348864:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:0.0:1789672697.695640:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695668:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695680:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695711:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695716:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695721:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695888:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695897:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695903:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672697.695961:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695975:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695982:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695990:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.695996:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672697.696000:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696017:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696042:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672697.696046:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672697.696053:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696060:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696078:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696085:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696091:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696096:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672697.696099:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696106:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696114:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05600) 00010000:00010000:0.0:1789672697.696116:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672697.696118:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696131:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696144:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696148:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696152:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696154:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672697.696156:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696159:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696163:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672697.696164:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672697.696166:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672697.696169:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0925e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672697.696261:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+35:11365:x1876607543348864:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 729us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672697.696268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 149 00000100:00100000:3.0:1789672697.698305:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672697.698395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543349120 00000100:00100000:2.0:1789672697.698406:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543349120 00000100:00100000:2.0:1789672697.698466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:2.0:1789672697.698474:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+35:11365:x1876607543349120:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672697.698772:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+36:11365:x1876607543349120:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 296us (474us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789672697.698829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:3.0:1789672697.764263:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672697.765242:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543349376 00000100:00100000:2.0:1789672697.765258:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543349376 00000100:00100000:2.0:1789672697.765395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 150 00000100:00100000:2.0:1789672697.765407:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+36:11368:x1876607543349376:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672697.765453:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672697.765481:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09265 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.765584:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.765602:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.765617:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.765633:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.765640:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672697.765647:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770278:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770311:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770326:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672697.770344:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789672697.770503:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770537:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770545:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770552:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672697.770558:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770568:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770586:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672697.770589:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672697.770596:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770603:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0926c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770624:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770631:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770637:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770643:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672697.770662:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770670:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770678:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa602b49a00) 00010000:00010000:3.0:1789672697.770680:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672697.770683:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770688:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770758:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09265 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770776:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.770896:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:3.0:1789672697.770900:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672697.770904:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67cc00, rc 0) 00000100:00100000:3.0:1789672697.771005:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+38:11368:x1876607543349376:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 5598us (6752us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789672697.771016:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 150 00000100:00100000:3.0:1789672697.780742:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672697.780776:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672697.780918:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672697.781299:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564323584 00000100:00100000:2.0:1789672697.781312:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564323584 00000100:00100000:2.0:1789672697.781375:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789672697.781395:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564323584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672697.781427:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672697.781500:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564323584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672697.781506:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672697.781832:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672697.782019:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672697.782116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543349504 00000100:00100000:3.0:1789672697.782122:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543349504 00000100:00100000:3.0:1789672697.782175:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 151 00000100:00100000:3.0:1789672697.782184:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+38:11368:x1876607543349504:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:3.0:1789672697.782259:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782282:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782298:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782332:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782340:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782348:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782354:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672697.782360:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782369:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782382:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:3.0:1789672697.782395:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672697.782402:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.782410:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09288 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672697.782487:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+38:11368:x1876607543349504:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 304us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672697.782494:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 151 00000100:00100000:2.0:1789672697.791307:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672697.791432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543349760 00000100:00100000:0.0:1789672697.791456:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543349760 00000100:00100000:0.0:1789672697.791532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 41 00000100:00100000:0.0:1789672697.791544:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+38:11368:x1876607543349760:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672697.791916:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+39:11368:x1876607543349760:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 373us (625us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789672697.791926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 41 00010000:00010000:0.0:1789672698.100447:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672698.221695:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672698.221924:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543350016 00000100:00100000:0.0:1789672698.221941:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543350016 00000100:00100000:0.0:1789672698.222029:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 152 00000100:00100000:0.0:1789672698.222042:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+39:11399:x1876607543350016:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:0.0:1789672698.222073:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672698.222102:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0928f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa1c expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.222226:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.222244:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.222260:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672698.222274:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789672698.222422:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0928f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa1c expref: 42 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.222457:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa1c expref: 41 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.222466:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672698.222470:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672698.222474:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672698.222541:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+41:11399:x1876607543350016:12345-192.168.202.39@tcp:101:cat.0 Request processed in 502us (862us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789672698.222548:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 152 00000100:00080000:1.0:1789672698.223571:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672698.226358:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672698.226452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543350272 00000100:00100000:0.0:1789672698.226466:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543350272 00000100:00100000:0.0:1789672698.226538:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:0.0:1789672698.226550:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+41:11399:x1876607543350272:12345-192.168.202.39@tcp:35:cat.0 00000100:00100000:0.0:1789672698.227007:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+42:11399:x1876607543350272:12345-192.168.202.39@tcp:35:cat.0 Request processed in 457us (662us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789672698.227017:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:3.0:1789672698.227452:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672698.227709:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543350400 00000100:00100000:1.0:1789672698.227717:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543350400 00000100:00100000:1.0:1789672698.227774:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:1.0:1789672698.227807:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+42:2359:x1876607543350400:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672698.227835:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672698.227866:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa1c expref: 42 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.227890:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672698.227897:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672698.227943:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+41:2359:x1876607543350400:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 161us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672698.227971:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:3.0:1789672698.327755:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672698.330930:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543350656 00000100:00100000:3.0:1789672698.330953:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543350656 00000100:00100000:3.0:1789672698.331055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 153 00000100:00100000:3.0:1789672698.331068:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+41:11405:x1876607543350656:12345-192.168.202.39@tcp:101:dd.0 00010000:00010000:3.0:1789672698.331102:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672698.331106:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672698.331141:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d091fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9f2 expref: 41 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.331167:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672698.331173:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672698.331189:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d092a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa23 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.331318:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.331336:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.331364:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.331409:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.331426:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 41 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672698.331442:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564323712:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672698.331569:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672698.343980:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672698.344023:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543350784 00000100:00100000:3.0:1789672698.344036:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543350784 00010000:00010000:3.0:1789672698.344094:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 42 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672698.344311:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564323712:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672698.344343:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672698.344407:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:3.0:1789672698.344420:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+42:2358:x1876607543350784:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672698.344438:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672698.344446:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 42 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.344460:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 42 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.344503:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0927a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa15 expref: 42 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.344521:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:3.0:1789672698.344526:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.344538:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.344547:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.344577:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672698.344642:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+41:2358:x1876607543350784:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 226us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672698.344661:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 65 00010000:00010000:2.0:1789672698.344853:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.344862:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672698.344885:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789672698.345210:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d092a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.345228:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.345236:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:2.0:1789672698.345238:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672698.345242:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:2.0:1789672698.345277:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+41:11405:x1876607543350656:12345-192.168.202.39@tcp:101:dd.0 Request processed in 14213us (17537us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789672698.345293:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 153 00000100:00100000:1.0:1789672698.349809:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672698.350017:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543351040 00000100:00100000:2.0:1789672698.350030:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543351040 00000100:00100000:2.0:1789672698.350106:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 154 00000100:00100000:2.0:1789672698.350118:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+41:11405:x1876607543351040:12345-192.168.202.39@tcp:36:dd.0 00010000:00010000:2.0:1789672698.350498:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.350522:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.350537:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672698.350601:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789672698.350634:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef5c1c15 reply state 00000000a3c6148b transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672698.350646:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672698.350954:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+44:11405:x1876607543351040:12345-192.168.202.39@tcp:36:dd.0 Request processed in 712us (1073us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789672698.350964:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 154 00000020:00080000:2.0:1789672698.350971:0:7918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789672698.355670:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.355694:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.355704:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.355710:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672698.355716:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.355741:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.356191:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:3.0:1789672698.356197:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672698.356206:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.356214:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d092b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672698.364660:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000004:00080000:1.0:1789672698.365117:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1789672698.365462:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672698.365491:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564323840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789672698.365588:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672698.365755:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564323840 00000100:00100000:2.0:1789672698.365776:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564323840 00000100:00100000:2.0:1789672698.365994:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789672698.366007:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876607564323840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789672698.366042:0:8063:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1789672698.366085:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aac3cf9, atime: 0x6aac3cfa, ctime: 0x6aac3cf9, blocks: 0x1 00010000:00010000:2.0:1789672698.366112:0:8063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.366134:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1789672698.366139:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672698.366148:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.366185:0:8063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.366198:0:8063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.366207:0:8063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672698.366235:0:8063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672698.367090:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672698.367100:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.367114:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672698.367120:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.367133:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.367157:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.367167:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e534454f/0x2247cb9491d092c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672698.367206:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672698.367208:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672698.367210:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672698.368232:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564323840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2219us (2635us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789672698.368246:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789672698.368391:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa62f0f4700/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789672698.368400:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564323840:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1789672698.368558:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa624e763c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789672698.368564:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa604be6b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa624e76180 00000020:00080000:1.0:1789672698.368568:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa604be6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa6088e3000 00000020:00080000:3.0:1789672698.368656:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789672698.368926:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:3.0:1789672698.483313:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672698.483329:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672698.488500:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789672698.488520:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672698.694502:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672698.696131:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543351168 00000100:00100000:0.0:1789672698.696152:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543351168 00000100:00100000:0.0:1789672698.696241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 155 00000100:00100000:0.0:1789672698.696255:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+19:11419:x1876607543351168:12345-192.168.202.39@tcp:101:stat.0 00010000:00010000:0.0:1789672698.696312:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672698.696342:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d092c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa2a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.696432:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.696452:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.696466:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.696484:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.696491:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.696499:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.697160:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.697176:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.697186:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.697234:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.697260:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 20 pid: 5830 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672698.697278:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564323968:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672698.697467:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63518cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672698.709093:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672698.711986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543351424 00000100:00100000:3.0:1789672698.712009:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543351424 00000100:00100000:3.0:1789672698.712105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:3.0:1789672698.712119:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+21:6056:x1876607543351424:12345-192.168.202.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789672698.712596:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+22:6056:x1876607543351424:12345-192.168.202.39@tcp:35:ldlm_bl.0 Request processed in 478us (3518us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789672698.712605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:0.0:1789672698.721364:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564323968:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672698.721415:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672698.723800:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672698.727711:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543351552 00000100:00100000:1.0:1789672698.727736:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543351552 00010000:00010000:1.0:1789672698.728398:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 22 pid: 5830 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672698.728467:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:1.0:1789672698.728483:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+22:2358:x1876607543351552:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672698.728515:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672698.728524:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 22 pid: 5830 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.728541:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 22 pid: 5830 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.728571:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa23 expref: 22 pid: 5830 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.728594:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672698.728621:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.728633:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.728653:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.729118:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672698.729216:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+21:2358:x1876607543351552:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 737us (5446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672698.729226:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 66 00010000:00010000:0.0:1789672698.733737:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.733761:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672698.739718:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789672698.739736:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672698.741188:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741227:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741241:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741248:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741255:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741262:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672698.741268:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741300:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741321:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:1.0:1789672698.741325:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672698.741332:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741339:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d092ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741359:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741365:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741371:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741377:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672698.741380:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741386:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741394:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05600) 00010000:00010000:1.0:1789672698.741397:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672698.741399:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741416:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d092d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741479:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d092c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa2a expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741496:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa2a expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672698.741503:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672698.741505:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672698.741508:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911200, rc 0) 00000100:00100000:1.0:1789672698.741618:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+20:11419:x1876607543351168:12345-192.168.202.39@tcp:101:stat.0 Request processed in 45364us (47131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672698.741629:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 155 00000100:00100000:2.0:1789672698.903617:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672698.903868:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543351808 00000100:00100000:0.0:1789672698.904068:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543351808 00000100:00100000:0.0:1789672698.904152:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 156 00000100:00100000:0.0:1789672698.904165:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+20:11425:x1876607543351808:12345-192.168.202.39@tcp:36:truncate.0 00010000:00010000:0.0:1789672698.904241:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672698.904278:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d092dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa2a expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.904305:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672698.904311:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672698.904612:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.904657:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.904670:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672698.904735:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1789672698.904764:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf2cc53 reply state 00000000210c842e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672698.904774:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672698.906461:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+22:11425:x1876607543351808:12345-192.168.202.39@tcp:36:truncate.0 Request processed in 2285us (2846us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789672698.906475:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 156 00000020:00080000:0.0:1789672698.906483:0:7918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789672698.912547:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.912573:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.912583:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.912590:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672698.912596:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.912605:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.912665:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672698.912669:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672698.912675:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672698.912683:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d092e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.131498:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672699.150146:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672699.150468:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543351936 00000100:00100000:3.0:1789672699.150482:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543351936 00000100:00100000:3.0:1789672699.150564:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 157 00000100:00100000:3.0:1789672699.150578:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+21:11439:x1876607543351936:12345-192.168.202.39@tcp:101:stat.0 00010000:00010000:3.0:1789672699.150612:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672699.150650:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d092ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa31 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.150769:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.150852:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.150867:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.150885:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.150893:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.150901:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151596:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151610:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151619:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672699.151679:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789672699.151685:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672699.151716:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151743:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151753:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151760:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151769:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151776:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67cc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672699.151781:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151819:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151834:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672699.151838:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672699.151844:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151851:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d092f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151866:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151874:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151889:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151895:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672699.151898:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151906:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151915:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa611330c00) 00010000:00010000:3.0:1789672699.151918:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672699.151921:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151928:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d092f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151968:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d092ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151985:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.151992:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:3.0:1789672699.151995:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672699.151998:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:3.0:1789672699.152093:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+22:11439:x1876607543351936:12345-192.168.202.39@tcp:101:stat.0 Request processed in 1517us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672699.152112:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 157 00000100:00100000:3.0:1789672699.230738:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672699.230972:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543352192 00000100:00100000:1.0:1789672699.230986:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543352192 00000100:00100000:1.0:1789672699.231059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 158 00000100:00100000:1.0:1789672699.231071:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+22:11449:x1876607543352192:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672699.231101:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672699.231130:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d09306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa38 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672699.231253:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789672699.231436:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d09306 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa38 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.231479:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:1.0:1789672699.231481:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672699.231488:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d09306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa38 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.231505:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542ec00, rc 0) 00000100:00100000:1.0:1789672699.231588:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+23:11449:x1876607543352192:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 518us (866us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789672699.231596:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 158 00000100:00100000:0.0:1789672699.238589:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672699.238702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543352448 00000100:00100000:3.0:1789672699.238718:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543352448 00000100:00100000:2.0:1789672699.238959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:2.0:1789672699.238976:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+23:11449:x1876607543352448:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672699.239539:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+24:11449:x1876607543352448:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 565us (966us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789672699.239566:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:2.0:1789672699.315110:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672699.315253:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543352704 00000100:00100000:3.0:1789672699.315267:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543352704 00000100:00100000:3.0:1789672699.315702:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 159 00000100:00100000:3.0:1789672699.315715:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+24:11455:x1876607543352704:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672699.315750:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672699.315780:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09314 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa3f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.315948:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.315968:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.315978:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.316024:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.316041:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 25 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672699.316057:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564324096:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672699.316199:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672699.319541:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672699.319693:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564324096:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672699.319776:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672699.321366:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543352832 00000100:00100000:2.0:1789672699.321385:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543352832 00010000:00010000:2.0:1789672699.321451:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 26 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672699.321508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 67 00000100:00100000:2.0:1789672699.321520:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+26:2357:x1876607543352832:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672699.321540:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672699.321548:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 26 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.321563:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 26 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.321594:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d092ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa31 expref: 26 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.321616:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:2.0:1789672699.321621:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.321633:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.321653:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.321718:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672699.321859:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+25:2357:x1876607543352832:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 339us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.321867:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 67 00010000:00010000:0.0:1789672699.321991:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.322003:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672699.322031:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789672699.323551:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09314 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.323583:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.323594:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672699.323597:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672699.323601:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c400, rc 0) 00000100:00100000:0.0:1789672699.323704:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+25:11455:x1876607543352704:12345-192.168.202.39@tcp:101:bash.0 Request processed in 7990us (8608us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789672699.323714:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 159 00000100:00100000:1.0:1789672699.327012:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.327109:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543353088 00000100:00100000:0.0:1789672699.327143:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543353088 00000100:00100000:0.0:1789672699.327223:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 160 00000100:00100000:0.0:1789672699.327236:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+25:11455:x1876607543353088:12345-192.168.202.39@tcp:36:bash.0 00010000:00010000:0.0:1789672699.327857:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.327893:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.327908:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672699.327978:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789672699.328006:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000723074de reply state 0000000065042bad transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672699.328016:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672699.328264:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+28:11455:x1876607543353088:12345-192.168.202.39@tcp:36:bash.0 Request processed in 1029us (1264us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789672699.328274:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 160 00000020:00080000:0.0:1789672699.328393:0:7918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789672699.336609:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.336635:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.336654:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.336661:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910e00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672699.336668:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.336678:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.336700:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672699.336722:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672699.336729:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.336736:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672699.337527:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672699.338057:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543353216 00000100:00100000:3.0:1789672699.338074:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543353216 00000100:00100000:3.0:1789672699.338160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 161 00000100:00100000:3.0:1789672699.338173:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+27:11455:x1876607543353216:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672699.338206:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672699.338231:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09330 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa46 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.338503:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.338521:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.338530:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.338574:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.338590:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 28 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672699.338605:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564324224:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672699.338833:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672699.346169:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.347488:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543353344 00000100:00100000:0.0:1789672699.347505:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543353344 00010000:00010000:0.0:1789672699.347581:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 29 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672699.347651:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 68 00000100:00100000:0.0:1789672699.347664:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+29:2358:x1876607543353344:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672699.347685:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672699.347694:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 29 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.347726:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 29 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.347754:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672699.347761:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.347773:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.347781:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.347852:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672699.347926:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+29:2358:x1876607543353344:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 265us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672699.347935:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 68 00010000:00010000:1.0:1789672699.351719:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0931b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa3f expref: 28 pid: 5830 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672699.351755:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564324224:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672699.352370:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.352388:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.352394:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672699.352464:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789672699.352469:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672699.352495:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.352550:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09330 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa46 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.352572:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa46 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.352613:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672699.352617:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672699.352622:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d600, rc 0) 00000100:00100000:1.0:1789672699.352737:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+27:11455:x1876607543353216:12345-192.168.202.39@tcp:101:bash.0 Request processed in 14565us (15218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672699.352748:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 161 00000100:00100000:3.0:1789672699.364269:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672699.364457:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543353600 00000100:00100000:2.0:1789672699.364472:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543353600 00000100:00100000:2.0:1789672699.364553:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:2.0:1789672699.364565:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+27:11455:x1876607543353600:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:2.0:1789672699.365304:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+28:11455:x1876607543353600:12345-192.168.202.39@tcp:35:bash.0 Request processed in 737us (1048us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789672699.365316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:3.0:1789672699.460316:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672699.464822:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543353856 00000100:00100000:1.0:1789672699.464844:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543353856 00000100:00100000:1.0:1789672699.464946:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 162 00000100:00100000:1.0:1789672699.464960:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+28:11465:x1876607543353856:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672699.464997:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672699.465029:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d0933e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa4d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672699.465158:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789672699.465320:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d0933e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa4d expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.465337:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:1.0:1789672699.465341:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672699.465347:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d0933e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa4d expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.465366:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e200, rc 0) 00000100:00100000:1.0:1789672699.465462:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+29:11465:x1876607543353856:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 505us (5168us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789672699.465491:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 162 00000100:00100000:3.0:1789672699.470266:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.472995:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543353984 00000100:00100000:0.0:1789672699.473017:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543353984 00000100:00100000:0.0:1789672699.473110:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 163 00000100:00100000:0.0:1789672699.473132:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+29:11465:x1876607543353984:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:0.0:1789672699.473242:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473354:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473370:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473410:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473418:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473425:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473842:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473853:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473860:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672699.473917:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473933:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473940:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473947:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473953:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672699.473959:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473973:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.473987:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672699.473991:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672699.473997:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474003:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0934c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474018:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474024:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474030:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474036:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910e00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672699.474039:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474045:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474051:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05300) 00010000:00010000:0.0:1789672699.474054:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672699.474056:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474072:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474088:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474094:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474100:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474106:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672699.474109:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474115:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474123:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672699.474125:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672699.474129:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.474134:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0935a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672699.474250:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+29:11465:x1876607543353984:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 1126us (3995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672699.474260:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 163 00000100:00100000:3.0:1789672699.478461:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.478517:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543354240 00000100:00100000:0.0:1789672699.478531:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543354240 00000100:00100000:0.0:1789672699.478615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:0.0:1789672699.478627:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+29:11465:x1876607543354240:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672699.479154:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+30:11465:x1876607543354240:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 526us (701us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789672699.479163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:3.0:1789672699.523599:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672699.523693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543354496 00000100:00100000:1.0:1789672699.523708:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543354496 00000100:00100000:1.0:1789672699.523953:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 164 00000100:00100000:1.0:1789672699.523968:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+30:11468:x1876607543354496:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672699.524001:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672699.524028:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa54 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524125:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524144:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524158:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524175:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524183:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524191:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524625:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d09376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524660:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d09376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524669:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d09376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672699.524682:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789672699.524826:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524836:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524845:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524852:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672699.524858:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524867:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524880:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:1.0:1789672699.524883:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672699.524890:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524896:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d09368 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524912:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524925:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524932:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524938:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672699.524941:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524948:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524956:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa6184b6200) 00010000:00010000:1.0:1789672699.524959:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672699.524963:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.524969:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0936f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.525023:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa54 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.525040:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d09376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa54 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.525049:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672699.525052:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672699.525060:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672699.525143:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+32:11468:x1876607543354496:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1178us (1554us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789672699.528609:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672699.528722:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.528837:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543354752 00000100:00100000:0.0:1789672699.528852:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543354752 00000100:00100000:0.0:1789672699.528961:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 165 00000100:00100000:0.0:1789672699.528975:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+33:11468:x1876607543354752:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:0.0:1789672699.529073:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529095:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529109:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529156:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529165:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529171:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529177:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672699.529201:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529210:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529225:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672699.529229:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672699.529235:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.529243:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672699.529692:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+33:11468:x1876607543354752:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 717us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672699.529701:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 165 00000100:00100000:3.0:1789672699.529779:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543354624 00000100:00100000:3.0:1789672699.529797:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543354624 00000100:00100000:3.0:1789672699.529858:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:3.0:1789672699.529867:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+33:2358:x1876607543354624:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672699.529881:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672699.529901:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d09376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa54 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672699.529917:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:3.0:1789672699.529921:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672699.529948:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+32:2358:x1876607543354624:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 82us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672699.529955:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:1.0:1789672699.531828:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 164 00000100:00100000:3.0:1789672699.531917:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672699.532080:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543355008 00000100:00100000:2.0:1789672699.532091:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543355008 00000100:00100000:2.0:1789672699.532162:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:2.0:1789672699.532172:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+32:11468:x1876607543355008:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672699.532494:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+33:11468:x1876607543355008:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 322us (576us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789672699.532502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:3.0:1789672699.652879:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.653676:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543355264 00000100:00100000:0.0:1789672699.653694:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543355264 00000100:00100000:0.0:1789672699.653993:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 166 00000100:00100000:0.0:1789672699.654006:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+32:11487:x1876607543355264:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:0.0:1789672699.654042:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672699.654071:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0938b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa5b expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.654231:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09392 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.654250:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09392 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.654285:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09392 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672699.654301:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789672699.654495:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d0938b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa5b expref: 35 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.654520:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09392 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa5b expref: 34 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.654530:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:0.0:1789672699.654533:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789672699.654538:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910e00, rc 0) 00000100:00100000:0.0:1789672699.654631:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+34:11487:x1876607543355264:12345-192.168.202.39@tcp:101:cat.0 Request processed in 628us (1769us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789672699.654648:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 166 00000100:00100000:2.0:1789672699.682528:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.682682:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543355392 00000100:00100000:0.0:1789672699.686620:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543355392 00000100:00100000:0.0:1789672699.686767:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 167 00000100:00100000:0.0:1789672699.686780:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+34:11488:x1876607543355392:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672699.686841:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672699.686974:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d093a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa62 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.687201:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d093a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.687243:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d093a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.687258:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d093a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672699.687304:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789672699.687308:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672699.687513:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d093a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.687549:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d093a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa62 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.687575:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d093a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa62 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672699.687584:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672699.687588:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672699.687593:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911c00, rc 0) 00000100:00100000:0.0:1789672699.687694:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+35:11488:x1876607543355392:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 916us (5178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672699.687703:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 167 00000100:00100000:3.0:1789672699.692743:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672699.698766:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543355776 00000100:00100000:2.0:1789672699.698801:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543355776 00000100:00100000:2.0:1789672699.698915:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:2.0:1789672699.698928:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+35:11488:x1876607543355776:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672699.699777:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+36:11488:x1876607543355776:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 846us (7045us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789672699.699810:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:3.0:1789672699.704106:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.708098:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543355904 00000100:00100000:0.0:1789672699.708181:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543355904 00000100:00100000:1.0:1789672699.709554:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:1.0:1789672699.709568:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+36:11488:x1876607543355904:12345-192.168.202.39@tcp:103:lfs.0 00010000:00010000:1.0:1789672699.709589:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789672699.709619:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa46 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.709687:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09392 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa5b expref: 35 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.709700:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d0923b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa07 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672699.709711:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05d00) 00010000:00010000:1.0:1789672699.709726:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672699.710137:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+33:11488:x1876607543355904:12345-192.168.202.39@tcp:103:lfs.0 Request processed in 569us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672699.710146:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:3.0:1789672699.712614:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672699.717842:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543356032 00000100:00100000:2.0:1789672699.717875:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543356032 00000100:00100000:2.0:1789672699.717978:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 168 00000100:00100000:2.0:1789672699.717989:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+33:11488:x1876607543356032:12345-192.168.202.39@tcp:58:lfs.0 00010000:00010000:2.0:1789672699.718148:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.718169:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.718184:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672699.719162:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789672699.719301:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+33:11488:x1876607543356032:12345-192.168.202.39@tcp:58:lfs.0 Request processed in 1308us (6696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.719651:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 168 00000100:00100000:3.0:1789672699.750226:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672699.752153:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543356160 00000100:00100000:0.0:1789672699.752174:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543356160 00000100:00100000:2.0:1789672699.754623:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 169 00000100:00100000:2.0:1789672699.754654:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+33:11490:x1876607543356160:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672699.754686:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672699.754715:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d093b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa69 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.754855:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.754898:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.754913:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.754935:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.754941:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.754948:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755305:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755316:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755325:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672699.755442:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789672699.755448:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672699.755472:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755493:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755514:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755521:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755528:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755534:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672699.755539:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755547:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755562:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672699.755565:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672699.755571:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755578:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d093bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755593:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755599:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755604:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755615:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672699.755618:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755624:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755632:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa602b49300) 00010000:00010000:2.0:1789672699.755647:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672699.755650:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755655:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d093c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755695:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d093b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755714:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672699.755722:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672699.755724:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672699.755727:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f600, rc 0) 00000100:00100000:2.0:1789672699.755874:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+34:11490:x1876607543356160:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1224us (5664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.755883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 169 00000100:00100000:0.0:1789672699.827324:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564324352:0@lo:400:kworker.0 00000100:00100000:0.0:1789672699.827471:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672699.827628:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564324480:0@lo:400:kworker.0 00000100:00100000:3.0:1789672699.827724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672699.827807:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564324480 00000100:00100000:3.0:1789672699.827828:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564324480 00000100:00100000:3.0:1789672699.827889:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789672699.827900:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564324480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672699.827963:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564324480:12345-0@lo:400:kworker.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672699.827970:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789672699.828020:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564324480:0@lo:400:kworker.0 00000100:00100000:0.0:1789672699.829187:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564324608:0@lo:400:kworker.0 00000100:00100000:0.0:1789672699.829252:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672699.829428:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564324736:0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.829466:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672699.829520:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564324736 00000100:00100000:1.0:1789672699.829527:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564324736 00000100:00100000:1.0:1789672699.829600:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789672699.829610:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564324736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672699.829645:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564324352 00000100:00100000:2.0:1789672699.829659:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564324352 00000100:00100000:1.0:1789672699.829696:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564324736:12345-0@lo:400:kworker.0 Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.829700:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789672699.829713:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.829722:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789672699.829749:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672699.829758:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564324352:12345-0@lo:400:kworker.0 Request processed in 47us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.829766:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789672699.829806:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564324736:0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.830135:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672699.830143:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564325120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672699.830176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672699.830221:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564324864:0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.830261:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564324992:0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.830282:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672699.830313:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564324992 00000100:00100000:1.0:1789672699.830316:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564324992 00000100:00100000:0.0:1789672699.830511:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672699.830562:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789672699.830569:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.830607:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564324992:12345-0@lo:400:kworker.0 Request processed in 38us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672699.830613:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789672699.830626:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672699.830656:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a22df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564324992:0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.830691:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564325120 00000100:00100000:1.0:1789672699.830694:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564325120 00000100:00100000:1.0:1789672699.830729:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789672699.830735:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564325120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672699.830769:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672699.830911:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564325120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672699.830919:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789672699.830949:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564325120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672699.835198:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564324608 00000100:00100000:0.0:1789672699.835205:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564324352:0@lo:400:kworker.0 00000100:00100000:2.0:1789672699.835218:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564324608 00000100:00080000:2.0:1789672699.835274:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672699.835732:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564324864 00000100:00100000:0.0:1789672699.835738:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564324864 00000100:00100000:1.0:1789672699.835742:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789672699.835760:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564324608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672699.835781:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789672699.835814:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564324864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672699.835915:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564324864:12345-0@lo:400:kworker.0 Request processed in 103us (5403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672699.835922:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789672699.835944:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672699.835977:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564324864:0@lo:400:kworker.0 00000100:00100000:1.0:1789672699.836120:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564324608:12345-0@lo:400:kworker.0 Request processed in 366us (6866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672699.836128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789672699.836188:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564324608:0@lo:400:kworker.0 00010000:00010000:3.0:1789672700.148942:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672700.531697:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672700.531710:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672700.531756:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789672700.531763:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672700.531955:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564325248:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672700.532080:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602bcd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672700.536186:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63570c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564325248:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672700.538377:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.538432:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543356288 00000100:00100000:2.0:1789672700.538445:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543356288 00000100:00100000:2.0:1789672700.538770:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 170 00000100:00100000:2.0:1789672700.538783:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+34:11501:x1876607543356288:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672700.539287:0:7918:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672700.539434:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+34:11501:x1876607543356288:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 652us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672700.539443:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 170 00000100:00080000:2.0:1789672700.539471:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789672700.544216:0:12456:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672700.544230:0:12456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672700.544276:0:12456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789672700.544283:0:12456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789672700.549653:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672700.550445:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543356416 00000100:00100000:0.0:1789672700.550460:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543356416 00000100:00100000:0.0:1789672700.550537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 171 00000100:00100000:0.0:1789672700.550549:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+34:11501:x1876607543356416:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789672700.550671:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.550693:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.550710:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.557842:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.557876:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.557892:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.557942:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.557952:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.557960:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672700.558024:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789672700.558028:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672700.558044:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558056:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558070:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558075:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558079:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672700.558083:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558090:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558101:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672700.558103:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672700.558108:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558114:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d093d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558127:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558133:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558138:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558144:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672700.558152:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558160:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558168:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9fa610c05300) 00010000:00010000:0.0:1789672700.558170:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672700.558172:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558176:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d093d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558189:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558192:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558195:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558199:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672700.558201:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558205:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558208:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672700.558209:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672700.558216:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.558220:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d093df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672700.560074:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+34:11501:x1876607543356416:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 Request processed in 9511us (10431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672700.560104:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 171 00000100:00100000:2.0:1789672700.564167:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.564222:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543356672 00000100:00100000:3.0:1789672700.564236:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543356672 00000100:00100000:0.0:1789672700.564333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 172 00000100:00100000:0.0:1789672700.564349:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+34:11501:x1876607543356672:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672700.564379:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672700.564406:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d093e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa70 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565659:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565683:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565697:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672700.565717:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789672700.565885:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565894:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565921:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565927:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672700.565932:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565940:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565954:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672700.565957:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672700.565964:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.565970:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d093ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.566026:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d093e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa70 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.566037:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672700.566039:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672700.566044:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d093e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa70 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.566053:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672700.566137:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+35:11501:x1876607543356672:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1791us (1981us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1789672700.566156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 172 00000100:00100000:3.0:1789672700.569039:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.570091:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543356800 00000100:00100000:2.0:1789672700.570109:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543356800 00000100:00100000:2.0:1789672700.570191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 173 00000100:00100000:2.0:1789672700.570205:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+35:11501:x1876607543356800:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672700.570257:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672700.570436:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+35:11501:x1876607543356800:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 234us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672700.570445:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 173 00000100:00100000:2.0:1789672700.574061:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.574135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543357056 00000100:00100000:3.0:1789672700.574149:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543357056 00000100:00100000:3.0:1789672700.574217:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 174 00000100:00100000:3.0:1789672700.574228:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+35:11501:x1876607543357056:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672700.574256:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672700.574261:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672700.574294:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d093a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa62 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.574313:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672700.574319:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672700.574448:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d093fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672700.579017:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789672700.579912:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.579989:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.580005:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.580097:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d093fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa77 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.580121:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa77 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.580131:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa610c05300) 00010000:00010000:0.0:1789672700.580134:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672700.580139:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672700.580236:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+36:11501:x1876607543357056:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 6009us (6187us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789672700.580247:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 174 00000100:00100000:2.0:1789672700.588505:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.589415:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543357312 00000100:00100000:3.0:1789672700.589431:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543357312 00000100:00100000:3.0:1789672700.589701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 175 00000100:00100000:3.0:1789672700.589716:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+36:11501:x1876607543357312:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789672700.589869:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672700.589903:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa77 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.589926:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa610c05300) 00010000:00010000:3.0:1789672700.589950:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672700.589981:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.589998:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590009:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590025:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590032:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590038:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590308:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590323:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590331:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590338:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ce00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672700.590343:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590352:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590361:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672700.590364:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672700.590369:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590376:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ce00/0x2247cb9491d09410 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590387:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590393:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590399:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590404:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672700.590413:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590419:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590427:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2c30758f (ffff9fa611330400) 00010000:00010000:3.0:1789672700.590430:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672700.590433:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.590438:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d09417 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2c30758f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672700.590579:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+35:11501:x1876607543357312:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 865us (2094us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672700.590588:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 175 00000100:00100000:0.0:1789672700.603761:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.604014:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543357440 00000100:00100000:3.0:1789672700.604027:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543357440 00000100:00100000:3.0:1789672700.604102:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 176 00000100:00100000:3.0:1789672700.604115:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+35:11501:x1876607543357440:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672700.604142:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672700.604173:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0941e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa7e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.604222:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.604239:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.604267:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.604393:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0941e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.604415:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.604423:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:3.0:1789672700.604427:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789672700.604431:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c200, rc 0) 00000100:00100000:3.0:1789672700.604519:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63570c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+36:11501:x1876607543357440:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 406us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672700.604527:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 176 00000100:00100000:0.0:1789672700.624292:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.624838:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543357696 00000100:00100000:3.0:1789672700.624853:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543357696 00000100:00100000:3.0:1789672700.624931:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 177 00000100:00100000:3.0:1789672700.624944:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+36:11501:x1876607543357696:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789672700.625067:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.625091:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.625107:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672700.627037:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789672700.627061:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369408274360ns, next at 370408269810ns, rc = 0 00000004:00010000:3.0:1789672700.627197:0:7918:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026916889 reply state 00000000278d7419 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672700.627211:0:7918:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672700.627682:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+38:11501:x1876607543357696:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 2733us (3412us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789672700.627694:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 177 00000100:00100000:2.0:1789672700.637584:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:0.0:1789672700.638423:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.638463:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.638472:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.638478:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ca00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672700.638484:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.638493:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.638513:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:0.0:1789672700.638516:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789672700.638523:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.638530:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0942c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672700.642706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543357824 00000100:00100000:2.0:1789672700.642729:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543357824 00000100:00100000:2.0:1789672700.642830:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 178 00000100:00100000:2.0:1789672700.642843:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+37:11501:x1876607543357824:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672700.642877:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672700.642905:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa85 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.642984:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.643003:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.643026:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:2.0:1789672700.643029:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672700.643034:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f000, rc 0) 00000100:00100000:2.0:1789672700.643122:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+38:11501:x1876607543357824:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 281us (5553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672700.643131:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 178 00000100:00100000:2.0:1789672700.658206:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.669046:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543357952 00000100:00100000:1.0:1789672700.669070:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543357952 00000100:00100000:1.0:1789672700.669196:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:1.0:1789672700.669209:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+6:2359:x1876607543357952:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789672700.669719:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543357952:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 511us (11527us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789672700.669730:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00080000:3.0:1789672700.670010:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672700.674010:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672700.675070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543358208 00000100:00100000:0.0:1789672700.675088:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543358208 00000100:00100000:0.0:1789672700.675219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:0.0:1789672700.675231:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+38:11501:x1876607543358208:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789672700.675779:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+39:11501:x1876607543358208:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 548us (1776us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789672700.675811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:1.0:1789672700.681310:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.681914:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543358464 00000100:00100000:3.0:1789672700.681929:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543358464 00000100:00100000:3.0:1789672700.682002:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 179 00000100:00100000:3.0:1789672700.682014:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+39:11501:x1876607543358464:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789672700.682164:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+39:11501:x1876607543358464:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 153us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672700.682172:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 179 00000100:00100000:3.0:1789672700.686728:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.688441:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543358592 00000100:00100000:1.0:1789672700.688461:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543358592 00000100:00100000:1.0:1789672700.688546:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 180 00000100:00100000:1.0:1789672700.688559:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+39:11501:x1876607543358592:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672700.688580:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672700.688619:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0943a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa8c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.688709:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.688723:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.688735:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672700.688772:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672700.688827:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.688861:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d0943a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa8c expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.688883:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa8c expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.688892:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:1.0:1789672700.688895:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789672700.688899:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e200, rc 0) 00000100:00100000:1.0:1789672700.688972:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+40:11501:x1876607543358592:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 416us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672700.688978:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 180 00000100:00100000:1.0:1789672700.697484:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672700.697608:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543358720 00000100:00100000:0.0:1789672700.697644:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543358720 00000100:00100000:0.0:1789672700.697810:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:0.0:1789672700.697827:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+7:2360:x1876607543358720:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672700.697855:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672700.697887:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa93 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672700.697923:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3cfd, blocks: 0x1 00010000:00010000:0.0:1789672700.697952:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1789672700.697957:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672700.697969:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.697992:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.698009:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911600, rc 0) 00000100:00100000:0.0:1789672700.698098:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+8:2360:x1876607543358720:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 275us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672700.698106:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:0.0:1789672700.704412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.704513:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543358976 00000100:00100000:1.0:1789672700.704533:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543358976 00000100:00100000:1.0:1789672700.704609:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 181 00000100:00100000:1.0:1789672700.704622:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+40:11501:x1876607543358976:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789672700.704810:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+40:11501:x1876607543358976:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 190us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672700.704818:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 181 00000100:00100000:2.0:1789672700.709814:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.709926:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543359104 00000100:00100000:1.0:1789672700.709941:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543359104 00000100:00100000:1.0:1789672700.710020:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:1.0:1789672700.710034:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+8:11501:x1876607543359104:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672700.710058:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672700.710082:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfa9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.710128:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.710139:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672700.710144:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672700.710150:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.710193:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.710210:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 9 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.710238:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564325376:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672700.710354:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672700.718052:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.718145:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543359232 00000100:00100000:2.0:1789672700.718162:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543359232 00010000:00010000:2.0:1789672700.718223:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 10 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672700.718278:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:2.0:1789672700.718290:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+10:2358:x1876607543359232:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672700.718309:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672700.718338:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 10 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.718354:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 10 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.718388:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672700.718394:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672700.718406:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 10 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.718416:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 10 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.718467:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 10 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672700.718485:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1876607564325504:192.168.202.39@tcp:105: 00000100:00100000:2.0:1789672700.718596:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789672700.719233:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ece656f8/0x2247cb9491d09448 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa93 expref: 10 pid: 6682 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.719253:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564325376:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672700.719284:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.719298:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e400, rc 0) 00000100:00100000:1.0:1789672700.719394:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+9:11501:x1876607543359104:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 9362us (9626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672700.719404:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:3.0:1789672700.723349:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1876607564325504:192.168.202.39@tcp:105: 00010000:00010000:3.0:1789672700.723480:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672700.723563:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543359232:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 5272us (5524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672700.723577:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:0.0:1789672700.724177:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.724250:0:11985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543359360 00000100:00100000:3.0:1789672700.724275:0:11985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543359360 00002000:00100000:3.0:1789672700.724335:0:11985:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fa503469f80 x1876607543359360/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:326/0 lens 504/0 e 0 to 0 dl 1789672711 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672700.724348:0:11985:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa503469f80 with x1876607543359360 ext(0->8) 00002000:00010000:3.0:1789672700.724354:0:11985:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa503469f80 00000100:00100000:3.0:1789672700.724504:0:11985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:3.0:1789672700.724518:0:11985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543359360:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789672700.725736:0:11985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7225c799-181e-4570-897c-b66842e45960+10:2357:x1876607543359360:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 Request processed in 1212us (1554us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789672700.725748:0:11985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00002000:00100000:3.0:1789672700.725761:0:11985:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fa503469f80 x1876607543359360/t4294967314(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:326/0 lens 504/448 e 0 to 0 dl 1789672711 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672700.725772:0:11985:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa503469f80 with x1876607543359360 ext(0->8) 00002000:00010000:3.0:1789672700.725777:0:11985:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa503469f80 00000100:00100000:0.0:1789672700.736919:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.737028:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543359488 00000100:00100000:3.0:1789672700.737041:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543359488 00000100:00100000:3.0:1789672700.737129:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 182 00000100:00100000:3.0:1789672700.737142:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+40:11501:x1876607543359488:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789672700.836234:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+40:11501:x1876607543359488:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 Request processed in 99077us (99398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672700.836251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 182 00000001:00080000:2.0:1789672700.836308:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1789672700.836376:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789672700.836415:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789672700.836739:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789672700.836752:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789672700.836770:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564325632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789672700.836865:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672700.836944:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564325632 00000100:00100000:2.0:1789672700.836954:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564325632 00000100:00100000:2.0:1789672700.837007:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789672700.837018:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564325632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789672700.837216:0:8063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789672700.837220:0:8063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789672701 00002000:00010000:2.0:1789672700.837223:0:8063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789672700.837225:0:8063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789672701 -> 1789672701 00002000:00010000:2.0:1789672700.837228:0:8063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789672700.837269:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564325632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 254us (405us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789672700.837277:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1789672700.837329:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa62f0f6300/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789672700.837336:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564325632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789672700.850129:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.850368:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543359616 00000100:00100000:2.0:1789672700.850400:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543359616 00000100:00100000:2.0:1789672700.850484:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672700.850499:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+10:2358:x1876607543359616:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789672700.945153:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789672700.945178:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789672700.945189:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1789672700.945903:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543359616:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 Request processed in 95252us (95635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672700.945922:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672700.950373:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.950698:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543359872 00000100:00100000:1.0:1789672700.950713:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543359872 00000100:00100000:1.0:1789672700.950836:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 183 00000100:00100000:1.0:1789672700.950850:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+18:11501:x1876607543359872:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672700.950924:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672700.950963:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d09441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa8c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.951024:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:1.0:1789672700.951031:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672700.951207:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.951232:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.951245:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672700.951596:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6397e74 reply state 00000000ed5ba6df transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672700.951608:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672700.953177:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+19:11501:x1876607543359872:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 2245us (2732us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789672700.953193:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 183 00000100:00100000:2.0:1789672700.959673:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.959774:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543360000 00000100:00100000:1.0:1789672700.959815:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543360000 00000100:00100000:1.0:1789672700.959897:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 56 00000100:00100000:1.0:1789672700.959909:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543360000:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789672700.960261:0:8063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789672700.960266:0:8063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789672701 -> 1789672699 00002000:00010000:1.0:1789672700.960270:0:8063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789672698 00002000:00010000:1.0:1789672700.960272:0:8063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789672701 -> 1789672699 00002000:00010000:1.0:1789672700.960275:0:8063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789672700.960357:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543360000:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 448us (702us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789672700.960367:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 56 00010000:00010000:3.0:1789672700.961342:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.961365:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.961404:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.961419:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672700.961425:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.961434:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.961459:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:3.0:1789672700.961463:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672700.961475:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.961482:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09456 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672700.962841:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.962914:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543360256 00000100:00100000:1.0:1789672700.962929:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543360256 00000100:00100000:1.0:1789672700.963011:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 184 00000100:00100000:1.0:1789672700.963022:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+18:11501:x1876607543360256:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789672700.963132:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.963153:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.963164:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.963248:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.963265:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 18 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.963283:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a22d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564325760:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672700.963428:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24840 going to sleep for 11 seconds 00000100:00100000:1.0:1789672700.966744:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a22d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564325760:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672700.966865:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672700.967833:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.967969:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543360384 00000100:00100000:2.0:1789672700.967990:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543360384 00010000:00010000:2.0:1789672700.968041:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672700.968084:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:2.0:1789672700.968095:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+19:2357:x1876607543360384:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672700.968114:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672700.968123:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.968137:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.968163:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa7e expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.968183:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:2.0:1789672700.968190:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.968202:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.968236:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.968280:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672700.968335:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968348:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672700.968357:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+18:2357:x1876607543360384:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 262us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672700.968366:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 70 00010000:00010000:0.0:1789672700.968391:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968401:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968409:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968416:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672700.968429:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968439:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968450:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:0.0:1789672700.968453:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789672700.968457:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672700.968464:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d0945d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672700.968511:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+17:11501:x1876607543360256:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 Request processed in 5491us (5681us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789672700.968521:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 184 00000100:00100000:0.0:1789672700.972839:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672700.972912:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543360512 00000100:00100000:1.0:1789672700.972926:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543360512 00000100:00100000:1.0:1789672700.972995:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:1.0:1789672700.973009:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+8:2360:x1876607543360512:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789672700.973071:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.973095:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.973117:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672700.973122:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672700.973128:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.973199:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.973217:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 8 pid: 6685 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.973238:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564325888:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672700.973349:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611f24840 going to sleep for 11 seconds 00000100:00100000:1.0:1789672700.978713:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564325888:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672700.978756:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672700.980452:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672700.981481:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543360640 00000100:00100000:3.0:1789672700.981497:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543360640 00010000:00010000:3.0:1789672700.981555:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 9 pid: 6685 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672700.981633:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 71 00000100:00100000:3.0:1789672700.981646:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+9:2358:x1876607543360640:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672700.981668:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672700.981703:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 9 pid: 6685 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.981745:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 9 pid: 6685 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.983316:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f346fe8a/0x2247cb9491d0944f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa9a expref: 9 pid: 6685 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.983347:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672700.983352:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672700.983359:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.983372:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672700.983434:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672700.983636:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983647:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672700.983650:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543360640:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 2004us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672700.983662:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 71 00010000:00010000:1.0:1789672700.983691:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983700:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983729:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983738:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672700.983743:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983754:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983771:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.983778:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d09464 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.985018:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2360:x1876607543360512:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 Request processed in 12004us (12203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672700.985032:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:0.0:1789672700.993184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.993272:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543360896 00000100:00100000:2.0:1789672700.993285:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543360896 00000100:00100000:2.0:1789672700.993366:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 185 00000100:00100000:2.0:1789672700.993378:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+17:11501:x1876607543360896:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789672700.993495:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.993517:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.993531:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.993917:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.993930:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.993939:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.994002:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672700.994019:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 18 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672700.994037:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564326016:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672700.994160:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672700.997612:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672700.997768:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564326016:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672700.997937:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.998292:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543361024 00000100:00100000:1.0:1789672700.998303:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543361024 00010000:00010000:1.0:1789672700.998355:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.998405:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 72 00000100:00100000:1.0:1789672700.998434:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+19:2358:x1876607543361024:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672700.998455:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672700.998464:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.998478:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.998505:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d09433 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa85 expref: 19 pid: 5830 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.998522:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:1.0:1789672700.998538:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.998550:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.998558:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672700.998590:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672700.998663:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.998670:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+18:2358:x1876607543361024:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 239us (1074us total) trans 0 rc 0/0 00010000:00010000:2.0:1789672700.998671:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672700.998678:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 72 00000001:00080000:2.0:1789672700.999149:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789672700.999329:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789672700.999383:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789672700.999484:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564326144:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789672700.999548:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672700.999588:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672700.999616:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564326144 00000100:00100000:1.0:1789672700.999632:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564326144 00000100:00100000:1.0:1789672700.999679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672700.999687:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7918:x1876607564326144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789672700.999882:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa608070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7918:x1876607564326144:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672700.999891:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789672700.999909:0:7918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789672700.999916:0:7918:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa62f0f6300, transno 4294967315 00000100:00100000:2.0:1789672700.999972:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564326144:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789672701.000461:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789672701.000527:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564326272:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789672701.000568:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672701.000600:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755000 going to sleep for 11 seconds 00000100:00100000:1.0:1789672701.000660:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564326272 00000100:00100000:1.0:1789672701.000666:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564326272 00000100:00100000:1.0:1789672701.000705:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789672701.000713:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7918:x1876607564326272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789672701.001079:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7918:x1876607564326272:12345-0@lo:1000:mdt00_003.0 Request processed in 365us (509us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789672701.001187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672701.002779:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564326272:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789672701.002867:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002880:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002890:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002897:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672701.002902:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002911:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002930:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa611330100) 00010000:00010000:2.0:1789672701.002934:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672701.002940:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002946:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09472 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.002987:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003016:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003022:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003027:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672701.003030:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003036:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003044:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672701.003046:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672701.003049:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003054:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d093ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003080:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003096:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003107:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003174:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.003200:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 21 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672701.003216:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f348380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564326400:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672701.003334:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672701.006010:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672701.006117:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f348380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564326400:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672701.006145:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672701.006293:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543361152 00000100:00100000:0.0:1789672701.006300:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543361152 00010000:00010000:0.0:1789672701.006337:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 22 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672701.006370:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00100000:0.0:1789672701.006377:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+22:2357:x1876607543361152:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672701.006392:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672701.006398:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 22 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672701.006420:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 22 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672701.006440:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d093ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfa69 expref: 22 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672701.006455:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672701.006459:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672701.006468:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672701.006474:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672701.006521:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672701.006589:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+21:2357:x1876607543361152:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 210us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672701.006596:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 73 00010000:00010000:2.0:1789672701.007705:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007720:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007736:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007743:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007750:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007757:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672701.007762:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007770:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007954:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672701.007958:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672701.007964:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007971:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09479 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007987:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007993:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.007999:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.008004:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672701.008007:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.008013:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.008021:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672701.008024:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672701.008026:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672701.008033:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d0946b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672701.008987:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672701.008995:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789672701.009148:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+20:11501:x1876607543360896:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 15766us (15974us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789672701.009161:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 185 00000020:00080000:2.0:1789672701.009167:0:7918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789672701.009445:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789672701.009453:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672701.019992:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672701.020130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543361408 00000100:00100000:2.0:1789672701.020144:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543361408 00000100:00100000:2.0:1789672701.020222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 50 00000100:00100000:2.0:1789672701.020234:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+20:11501:x1876607543361408:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789672701.021237:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789672701.021358:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789672701.021421:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.021443:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.021459:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.021470:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.021477:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.021484:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.021614:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672701.021764:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+22:11501:x1876607543361408:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 1530us (1789us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789672701.021775:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 50 00000020:00080000:1.0:1789672701.021782:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789672701.022992:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672701.023005:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672701.023016:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672701.023036:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672701.023047:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672701.023065:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa6184b6200) 00010000:00010000:3.0:1789672701.023069:0:8499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789672701.023075:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672701.023082:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09480 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672701.029319:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672701.029330:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672701.029334:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672701.171078:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789672701.459754:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789672701.460042:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1789672701.460320:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:1.0:1789672701.611770:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672701.611884:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672701.611929:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672701.616053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543361536 00000100:00100000:0.0:1789672701.616080:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543361536 00000100:00100000:0.0:1789672701.616217:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 293 00000100:00100000:0.0:1789672701.616231:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543361536:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672701.616368:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543361536:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 141us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672701.616377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 293 00000100:00100000:2.0:1789672701.617272:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543361664 00000100:00100000:2.0:1789672701.617287:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543361664 00000100:00100000:2.0:1789672701.617385:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:2.0:1789672701.617395:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543361664:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672701.617474:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+5:2357:x1876607543361664:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 81us (5719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672701.617482:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00080000:0.0:1789672701.618429:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672701.622031:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543361792 00000100:00100000:3.0:1789672701.622055:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543361792 00000100:00100000:3.0:1789672701.622218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 152 00000100:00100000:3.0:1789672701.622232:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543361792:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672701.622361:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2357:x1876607543361792:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 132us (10431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672701.622370:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 152 00000100:00080000:0.0:1789672701.628079:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672702.195077:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789672702.340252:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672702.340267:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672702.340319:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789672702.340326:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672702.490155:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.490257:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543362048 00000100:00100000:3.0:1789672702.490272:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543362048 00000100:00100000:3.0:1789672702.490379:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 186 00000100:00100000:3.0:1789672702.490411:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+22:11519:x1876607543362048:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672702.490452:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672702.490480:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d09487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfaa1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789672702.490672:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672702.490759:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0948e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.490777:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0948e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.490920:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0948e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672702.490938:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789672702.491109:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d09487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa1 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.491134:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0948e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa1 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.491144:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672702.491148:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789672702.491153:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672702.491245:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+24:11519:x1876607543362048:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 837us (1106us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789672702.491255:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 186 00000100:00100000:1.0:1789672702.503986:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672702.506929:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543362176 00000100:00100000:0.0:1789672702.506952:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543362176 00000100:00100000:0.0:1789672702.507044:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 187 00000100:00100000:0.0:1789672702.507057:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+24:11519:x1876607543362176:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:0.0:1789672702.507173:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507197:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507214:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507231:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507240:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507247:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507552:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507583:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507592:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672702.507656:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507671:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507679:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507686:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507693:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.507698:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507707:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507721:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672702.507724:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.507730:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507736:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0949c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507757:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507763:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507770:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507775:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.507778:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507821:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507832:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05c00) 00010000:00010000:0.0:1789672702.507836:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.507839:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507847:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507867:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507875:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507882:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507895:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.507898:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507906:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507914:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa610c05600) 00010000:00010000:0.0:1789672702.507917:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.507920:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.507926:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d094aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672702.508048:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+24:11519:x1876607543362176:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 991us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672702.508057:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 187 00000100:00100000:0.0:1789672702.552339:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672702.552444:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543362432 00000100:00100000:2.0:1789672702.552458:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543362432 00000100:00100000:2.0:1789672702.552533:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 188 00000100:00100000:2.0:1789672702.552548:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+24:11522:x1876607543362432:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672702.552585:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672702.552624:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d094b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfaa8 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.552734:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.552753:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.552768:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.552980:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.552992:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.553000:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.553339:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.553349:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.553357:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672702.553369:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789672702.557768:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557807:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557825:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557832:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672702.557838:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557849:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557869:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672702.557873:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672702.557879:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557886:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d094b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557901:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557907:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557913:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557918:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672702.557921:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557938:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557946:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672702.557948:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672702.557951:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.557956:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.558029:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d094b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 27 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.558047:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 26 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.558055:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:2.0:1789672702.558058:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672702.558060:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fc00, rc 0) 00000100:00100000:2.0:1789672702.558167:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+26:11522:x1876607543362432:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 5621us (5846us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789672702.558179:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 188 00000100:00100000:3.0:1789672702.563157:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.563204:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543362560 00000100:00100000:3.0:1789672702.563235:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543362560 00000100:00100000:3.0:1789672702.563313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 189 00000100:00100000:3.0:1789672702.563326:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:11522:x1876607543362560:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:3.0:1789672702.563429:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563451:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563464:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563494:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563500:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563505:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563509:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672702.563513:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563518:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563529:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:3.0:1789672702.563532:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672702.563538:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.563555:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672702.563652:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+26:11522:x1876607543362560:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 328us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672702.563662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 189 00000100:00100000:3.0:1789672702.566579:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672702.568420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543362816 00000100:00100000:1.0:1789672702.568442:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543362816 00000100:00100000:1.0:1789672702.568538:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:1.0:1789672702.568551:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+26:11522:x1876607543362816:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672702.568934:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+27:11522:x1876607543362816:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 385us (2367us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789672702.568943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:2.0:1789672702.602009:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672702.610254:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363072 00000100:00100000:2.0:1789672702.610277:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363072 00000100:00100000:2.0:1789672702.610364:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 190 00000100:00100000:2.0:1789672702.610378:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+27:11047:x1876607543363072:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672702.610422:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672702.610454:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d094db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfaaf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.610623:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.610641:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 28 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.610652:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.610704:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 28 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.610720:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 28 pid: 7918 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672702.610738:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f34a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564326528:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672702.610925:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672702.616355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.616388:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363200 00000100:00100000:3.0:1789672702.616397:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363200 00010000:00010000:3.0:1789672702.616439:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 29 pid: 7918 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672702.616482:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 74 00000100:00100000:3.0:1789672702.616493:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+29:2358:x1876607543363200:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672702.616511:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672702.616518:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 29 pid: 7918 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.616531:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 29 pid: 7918 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.616549:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:3.0:1789672702.616553:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.616559:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.616578:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.616593:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672702.616646:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+29:2358:x1876607543363200:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 156us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672702.616652:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 74 00010000:00010000:3.0:1789672702.617197:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d094c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa8 expref: 28 pid: 7918 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672702.617215:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f34a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564326528:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672702.617247:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.617255:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.617259:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672702.617274:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789672702.617392:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d094db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.617404:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.617410:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:3.0:1789672702.617418:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789672702.617420:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f400, rc 0) 00000100:00100000:3.0:1789672702.617450:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+28:11047:x1876607543363072:12345-192.168.202.39@tcp:101:bash.0 Request processed in 7077us (15452us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789672702.617455:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 190 00000100:00100000:3.0:1789672702.625160:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.625206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363456 00000100:00100000:3.0:1789672702.625218:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363456 00000100:00100000:3.0:1789672702.625283:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 191 00000100:00100000:3.0:1789672702.625295:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+28:11047:x1876607543363456:12345-192.168.202.39@tcp:36:bash.0 00010000:00010000:3.0:1789672702.625677:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.625699:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.625713:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672702.625777:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789672702.625831:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ff0e0a5 reply state 00000000ee4bb3c0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672702.625842:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789672702.625897:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789672702.626023:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+32:11047:x1876607543363456:12345-192.168.202.39@tcp:36:bash.0 Request processed in 729us (877us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789672702.626032:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 191 00000020:00080000:3.0:1789672702.626037:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789672702.635879:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:0.0:1789672702.635923:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.635938:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.635948:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.635956:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.635972:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.635981:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.636002:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:0.0:1789672702.636005:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.636011:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.636018:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d094f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672702.636061:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363584 00000100:00100000:0.0:1789672702.636073:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363584 00000100:00100000:0.0:1789672702.636140:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 192 00000100:00100000:0.0:1789672702.636152:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+31:11047:x1876607543363584:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:0.0:1789672702.636183:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672702.636207:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfab6 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.636307:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfab6 expref: 32 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.636325:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfab6 expref: 32 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.636348:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:0.0:1789672702.636351:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672702.636360:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911600, rc 0) 00000100:00100000:0.0:1789672702.636434:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+32:11047:x1876607543363584:12345-192.168.202.39@tcp:101:bash.0 Request processed in 284us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672702.636443:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 192 00000100:00100000:1.0:1789672702.646330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.649256:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363712 00000100:00100000:3.0:1789672702.649292:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363712 00000100:00100000:3.0:1789672702.649395:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 58 00000100:00100000:3.0:1789672702.649408:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:11047:x1876607543363712:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672702.649435:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672702.649466:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfabd expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672702.649501:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aac3cfb, atime: 0x6aac3cfa, ctime: 0x6aac3cfb, blocks: 0xb 00010000:00010000:3.0:1789672702.649531:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1789672702.649536:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672702.649545:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.649567:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.649583:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ce00, rc 0) 00000100:00100000:3.0:1789672702.649672:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+8:11047:x1876607543363712:12345-192.168.202.39@tcp:101:bash.0 Request processed in 266us (3355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672702.649679:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 58 00000100:00080000:0.0:1789672702.653134:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672702.669782:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.670196:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363840 00000100:00100000:3.0:1789672702.670211:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363840 00002000:00010000:3.0:1789672702.670267:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789672702.670273:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa503468e00 with x1876607543363840 ext(0->18446744073709551615) 00002000:00010000:3.0:1789672702.670290:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa503468e00. 00000100:00100000:3.0:1789672702.670331:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:3.0:1789672702.670343:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+8:2359:x1876607543363840:12345-192.168.202.39@tcp:10:bash.0 00002000:00010000:3.0:1789672702.670739:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789672702.670743:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789672699 -> 1789672703 00002000:00010000:3.0:1789672702.670746:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789672698 -> 1789672698 00002000:00010000:3.0:1789672702.670749:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789672699 -> 1789672703 00002000:00010000:3.0:1789672702.670751:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789672702.671453:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7225c799-181e-4570-897c-b66842e45960+9:2359:x1876607543363840:12345-192.168.202.39@tcp:10:bash.0 Request processed in 1106us (1676us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789672702.671464:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00002000:00010000:3.0:1789672702.671471:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789672702.671474:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa503468e00 with x1876607543363840 ext(0->18446744073709551615) 00002000:00010000:3.0:1789672702.671482:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa503468e00. 00000100:00100000:3.0:1789672702.722735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672702.722857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543363968 00000100:00100000:0.0:1789672702.722872:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543363968 00000100:00100000:0.0:1789672702.722954:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 193 00000100:00100000:0.0:1789672702.722967:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+32:11536:x1876607543363968:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:0.0:1789672702.723078:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723100:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723115:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723133:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723140:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723146:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723463:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723473:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723491:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672702.723546:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723560:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723567:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723574:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723582:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.723586:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723595:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723623:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672702.723627:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.723632:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723639:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723654:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723666:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723673:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723678:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.723681:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723687:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723695:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05600) 00010000:00010000:0.0:1789672702.723698:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.723701:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723707:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d0950c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723723:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723730:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723736:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723740:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.723748:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723754:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723762:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:0.0:1789672702.723764:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.723767:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.723772:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672702.724171:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+32:11536:x1876607543363968:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 1202us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672702.724184:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 193 00000100:00100000:1.0:1789672702.768414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672702.769242:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543364224 00000100:00100000:0.0:1789672702.769260:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543364224 00000100:00100000:0.0:1789672702.769354:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 194 00000100:00100000:0.0:1789672702.769368:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+32:11539:x1876607543364224:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672702.769399:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672702.769429:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d0951a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfac4 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.769523:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.769542:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.769593:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.769622:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.769632:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.769639:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770044:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0952f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770056:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0952f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770065:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0952f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672702.770078:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789672702.770236:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770245:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770253:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770259:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910c00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.770272:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770281:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770296:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672702.770300:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.770305:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770312:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910c00/0x2247cb9491d09521 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770327:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770334:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770341:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770346:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672702.770350:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770355:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770363:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05600) 00010000:00010000:0.0:1789672702.770366:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672702.770375:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770382:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770435:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d0951a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfac4 expref: 35 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770451:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0952f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfac4 expref: 34 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.770460:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:0.0:1789672702.770462:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789672702.770465:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911c00, rc 0) 00000100:00100000:0.0:1789672702.770559:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+34:11539:x1876607543364224:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1193us (2163us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789672702.770568:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 194 00000100:00100000:3.0:1789672702.773318:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672702.774485:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543364352 00000100:00100000:0.0:1789672702.774502:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543364352 00000100:00100000:0.0:1789672702.774589:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 195 00000100:00100000:0.0:1789672702.774602:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+34:11539:x1876607543364352:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:0.0:1789672702.774700:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.774720:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.774730:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.774812:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.774828:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 34 pid: 5832 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672702.774846:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564326656:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672702.774965:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672702.777033:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672702.777491:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543364608 00000100:00100000:1.0:1789672702.777505:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543364608 00000100:00100000:1.0:1789672702.777634:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:1.0:1789672702.777647:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+35:5596:x1876607543364608:12345-192.168.202.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789672702.777707:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564326656:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672702.777742:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672702.778184:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+36:5596:x1876607543364608:12345-192.168.202.39@tcp:35:ldlm_bl.0 Request processed in 537us (1160us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789672702.778212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:1.0:1789672702.780560:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672702.780665:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543364736 00000100:00100000:0.0:1789672702.780677:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543364736 00010000:00010000:0.0:1789672702.780737:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 36 pid: 5832 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672702.780809:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:0.0:1789672702.780822:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+36:2358:x1876607543364736:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672702.780841:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672702.780851:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 36 pid: 5832 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.780865:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 36 pid: 5832 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.781192:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d094e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaaf expref: 36 pid: 5832 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.781212:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:0.0:1789672702.781219:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.781232:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.781241:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672702.781275:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672702.781340:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+35:2358:x1876607543364736:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 520us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672702.781348:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 75 00010000:00010000:1.0:1789672702.781467:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781476:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781512:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781520:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781527:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781534:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672702.781539:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781548:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781557:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:1.0:1789672702.781560:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672702.781564:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672702.781570:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d0953d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672702.781640:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+34:11539:x1876607543364352:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 7040us (8337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672702.781649:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 195 00000100:00100000:0.0:1789672702.787688:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.787880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543364992 00000100:00100000:3.0:1789672702.787951:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543364992 00000100:00100000:3.0:1789672702.788026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:3.0:1789672702.788038:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+34:11539:x1876607543364992:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:3.0:1789672702.788420:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+35:11539:x1876607543364992:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 381us (743us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789672702.788438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:0.0:1789672702.899194:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672702.899307:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672702.899474:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564326784 00000100:00100000:2.0:1789672702.899485:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564326784 00000100:00100000:2.0:1789672702.899560:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672702.899572:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564326784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672702.899637:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672702.899722:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564326784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672702.899751:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789672702.900692:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789672702.900702:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789672702.900853:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa62f0f4700, transno 4294967307 00000100:00100000:3.0:1789672702.900894:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564326784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789672702.901029:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672702.907503:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.907733:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543365248 00000100:00100000:3.0:1789672702.907748:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543365248 00000100:00100000:3.0:1789672702.907840:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 196 00000100:00100000:3.0:1789672702.907854:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+35:11550:x1876607543365248:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:3.0:1789672702.907896:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672702.907923:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09544 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfacb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908014:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908032:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908046:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908062:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908070:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908077:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908442:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908453:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908473:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672702.908486:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789672702.908618:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908627:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908636:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908643:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67cc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672702.908648:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908658:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908673:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672702.908676:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672702.908682:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908689:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0954b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908704:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908710:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908725:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908731:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672702.908734:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908740:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908747:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa611330e00) 00010000:00010000:3.0:1789672702.908750:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672702.908752:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908759:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09552 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908856:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09544 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfacb expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908873:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfacb expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.908882:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:3.0:1789672702.908884:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672702.908887:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67dc00, rc 0) 00000100:00100000:3.0:1789672702.908980:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f349180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+37:11550:x1876607543365248:12345-192.168.202.39@tcp:101:cat.0 Request processed in 1128us (1490us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789672702.908999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 196 00000100:00100000:1.0:1789672702.924903:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.925013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543365504 00000100:00100000:3.0:1789672702.925029:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543365504 00000100:00100000:3.0:1789672702.925110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 54 00000100:00100000:3.0:1789672702.925123:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+37:11550:x1876607543365504:12345-192.168.202.39@tcp:35:cat.0 00000100:00100000:3.0:1789672702.925473:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+38:11550:x1876607543365504:12345-192.168.202.39@tcp:35:cat.0 Request processed in 352us (595us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789672702.925482:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 54 00000100:00100000:2.0:1789672702.971407:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672702.971672:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543365760 00000100:00100000:3.0:1789672702.971687:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543365760 00000100:00100000:3.0:1789672702.972038:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 197 00000100:00100000:3.0:1789672702.972053:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+38:11551:x1876607543365760:12345-192.168.202.39@tcp:36:rm.0 00010000:00010000:3.0:1789672702.972137:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789672702.972174:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfacb expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972204:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0952f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfac4 expref: 37 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972216:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d094f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfab6 expref: 36 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972227:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa602b49500) 00010000:00010000:3.0:1789672702.972239:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672702.972263:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972294:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972306:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972325:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972332:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972338:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972672:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972681:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.972688:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672702.978525:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789672702.978541:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371759754745ns, next at 372759751951ns, rc = 0 00010000:00010000:3.0:1789672702.978644:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.978665:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.978692:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.978703:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.978711:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.978717:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.978748:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672702.978776:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.978985:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672702.978994:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979102:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979111:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.979358:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672702.979365:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.979376:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.979394:0:8499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330700) 00010000:00010000:2.0:1789672702.979398:0:8499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789672702.979404:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.979412:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d0957c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.979431:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672702.979433:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672702.979435:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672702.979468:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67cc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672702.979473:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979481:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979490:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa611330700) 00010000:00010000:3.0:1789672702.979493:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789672702.979509:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979515:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d09575 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979544:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979551:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979557:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979562:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672702.979565:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979571:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979579:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672702.979581:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672702.979584:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672702.979589:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09567 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672702.979599:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018d0da7d reply state 000000006b7a0c7d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672702.979633:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672702.979993:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+37:11551:x1876607543365760:12345-192.168.202.39@tcp:36:rm.0 Request processed in 7937us (8596us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789672702.980005:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 197 00010000:00010000:2.0:1789672702.987471:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.987496:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.987535:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.987542:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672702.987549:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.987558:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.987579:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa611330e00) 00010000:00010000:2.0:1789672702.987583:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672702.987589:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672702.987595:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d0956e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.016950:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.017044:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543366016 00000100:00100000:3.0:1789672703.017059:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543366016 00000100:00100000:3.0:1789672703.017146:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 198 00000100:00100000:3.0:1789672703.017158:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+36:11557:x1876607543366016:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672703.017191:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672703.017216:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09583 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfad2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.017372:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.017389:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.017402:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.017417:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.017424:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.017430:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672703.018219:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789672703.018454:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018467:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018479:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018522:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018530:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018537:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018545:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67cc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672703.018550:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018559:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018575:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672703.018579:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672703.018585:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018601:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d0958a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672703.018632:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd728ccb reply state 000000005686f1b8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.018643:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789672703.018685:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09583 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018703:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.018710:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:3.0:1789672703.018713:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672703.018716:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c400, rc 0) 00000100:00100000:3.0:1789672703.018866:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+39:11557:x1876607543366016:12345-192.168.202.39@tcp:101:bash.0 Request processed in 1709us (1930us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789672703.018877:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 198 00010000:00010000:2.0:1789672703.023309:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.023332:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.023341:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.023348:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67dc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.023354:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.023385:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.023407:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa611330700) 00010000:00010000:2.0:1789672703.023410:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.023417:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.023424:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67dc00/0x2247cb9491d09591 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.024038:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672703.024348:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543366144 00000100:00100000:1.0:1789672703.024361:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543366144 00000100:00100000:1.0:1789672703.024451:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:1.0:1789672703.024463:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+5:2358:x1876607543366144:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:1.0:1789672703.024487:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672703.024512:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfad9 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672703.024544:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789672703.024570:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1789672703.024575:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672703.024587:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.024622:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.024636:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fe00, rc 0) 00000100:00100000:1.0:1789672703.024721:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+6:2358:x1876607543366144:12345-192.168.202.39@tcp:101:bash.0 Request processed in 250us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672703.024730:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00080000:0.0:1789672703.024877:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672703.029742:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.029921:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543366272 00000100:00100000:3.0:1789672703.029935:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543366272 00000100:00100000:3.0:1789672703.030008:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:3.0:1789672703.030021:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+6:11557:x1876607543366272:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672703.030043:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672703.030067:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfae0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.030396:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.030408:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672703.030414:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672703.030420:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.030466:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.030482:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 7 pid: 6682 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.030501:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876607564326912:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672703.030639:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672703.037029:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.037163:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1876607564326912:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672703.037186:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543366400 00000100:00100000:0.0:1789672703.037196:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543366400 00010000:00010000:2.0:1789672703.037215:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.037238:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 8 pid: 6682 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.037252:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:0.0:1789672703.037282:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:0.0:1789672703.037312:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543366400:12345-192.168.202.39@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789672703.037317:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+8:11557:x1876607543366272:12345-192.168.202.39@tcp:101:bash.0 Request processed in 7300us (7591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.037324:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 60 00010000:00010000:0.0:1789672703.037328:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672703.037354:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 7 pid: 6682 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.037369:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 7 pid: 6682 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.037396:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad9 expref: 7 pid: 6682 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.037413:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672703.037418:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672703.037428:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.037440:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.037480:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672703.037496:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1876607564327040:192.168.202.39@tcp:105: 00000100:00100000:0.0:1789672703.037560:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672703.042992:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1876607564327040:192.168.202.39@tcp:105: 00010000:00010000:3.0:1789672703.043028:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672703.043199:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543366400:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 5886us (6184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672703.043213:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:1.0:1789672703.049599:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.049915:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543366656 00000100:00100000:3.0:1789672703.049933:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543366656 00000100:00100000:3.0:1789672703.050038:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:3.0:1789672703.050052:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+38:11557:x1876607543366656:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:3.0:1789672703.050690:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+39:11557:x1876607543366656:12345-192.168.202.39@tcp:35:bash.0 Request processed in 637us (1103us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789672703.050701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 55 00000100:00100000:2.0:1789672703.206037:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672703.206308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543366784 00000100:00100000:1.0:1789672703.206322:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543366784 00000100:00100000:1.0:1789672703.206399:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 199 00000100:00100000:1.0:1789672703.206412:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+39:11573:x1876607543366784:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672703.206559:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672703.206589:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d095b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfae7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.206692:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d095bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.206722:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d095bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.206738:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d095bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672703.207001:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789672703.207005:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672703.207375:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d095bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.207502:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e200/0x2247cb9491d095b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae7 expref: 41 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.207530:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d095bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae7 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.207540:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672703.207544:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672703.207548:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e400, rc 0) 00000100:00100000:0.0:1789672703.207699:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+40:11573:x1876607543366784:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1288us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672703.207718:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 199 00000100:00100000:0.0:1789672703.213186:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.213343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543367040 00000100:00100000:3.0:1789672703.213358:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543367040 00000100:00100000:3.0:1789672703.213520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 200 00000100:00100000:3.0:1789672703.213533:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+40:11573:x1876607543367040:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672703.213563:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672703.213594:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfaee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.213750:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d095c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.213770:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d095c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.213877:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d095c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672703.213895:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789672703.214067:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaee expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.214159:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d095c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaee expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.214193:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:3.0:1789672703.214196:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672703.214201:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67cc00, rc 0) 00000100:00100000:3.0:1789672703.214515:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+42:11573:x1876607543367040:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 983us (1341us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789672703.214524:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 200 00010000:00010000:3.0:1789672703.219371:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672703.220550:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672703.220614:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672703.220726:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543367424 00000100:00100000:0.0:1789672703.220741:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543367424 00000100:00100000:0.0:1789672703.220851:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:0.0:1789672703.220864:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+42:2358:x1876607543367424:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672703.220885:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672703.220920:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67cc00/0x2247cb9491d095c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaee expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.220945:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:0.0:1789672703.220953:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672703.221032:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+41:2358:x1876607543367424:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 170us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672703.221040:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:2.0:1789672703.221289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543367296 00000100:00100000:2.0:1789672703.221295:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543367296 00000100:00100000:2.0:1789672703.221336:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 201 00000100:00100000:2.0:1789672703.221343:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+41:11573:x1876607543367296:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672703.221369:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672703.221389:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d095d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfaf5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.221855:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d095de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.221876:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d095de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.221890:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d095de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672703.221905:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789672703.222058:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ea00/0x2247cb9491d095d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaf5 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.222336:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d095de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaf5 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.222347:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:2.0:1789672703.222350:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789672703.222354:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f200, rc 0) 00000100:00100000:2.0:1789672703.222410:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+43:11573:x1876607543367296:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1067us (1871us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789672703.222419:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 201 00000100:00100000:2.0:1789672703.231412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672703.231565:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543367552 00000100:00100000:1.0:1789672703.231579:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543367552 00000100:00100000:1.0:1789672703.231696:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:1.0:1789672703.231709:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+6:2357:x1876607543367552:12345-192.168.202.39@tcp:1:lfs.0 00010000:00010000:1.0:1789672703.231770:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.232377:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.232713:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789672703.232719:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672703.232726:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.233059:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.233144:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 6 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672703.233165:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876607564327168:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672703.233327:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672703.237361:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.237458:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543367680 00000100:00100000:3.0:1789672703.237472:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543367680 00002000:00100000:3.0:1789672703.237540:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fa63a22c700 x1876607543367680/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:329/0 lens 504/0 e 0 to 0 dl 1789672714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672703.237552:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63a22c700 with x1876607543367680 ext(0->8) 00010000:00010000:3.0:1789672703.237562:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 7 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.237582:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 7 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672703.237590:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa63a22c700 00000100:00100000:3.0:1789672703.237636:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:3.0:1789672703.237648:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543367680:12345-192.168.202.39@tcp:4:lfs.0 00000100:00100000:3.0:1789672703.238359:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7225c799-181e-4570-897c-b66842e45960+9:2358:x1876607543367680:12345-192.168.202.39@tcp:4:lfs.0 Request processed in 708us (1008us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789672703.238370:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 3 00002000:00100000:3.0:1789672703.238388:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fa63a22c700 x1876607543367680/t4294967308(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:329/0 lens 504/448 e 0 to 0 dl 1789672714 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672703.238397:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63a22c700 with x1876607543367680 ext(0->8) 00010000:00010000:3.0:1789672703.238405:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 9 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.238421:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 9 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672703.238430:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa63a22c700 00000100:00100000:2.0:1789672703.239331:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1876607564327168:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672703.239369:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672703.241443:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.241527:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543367808 00000100:00100000:2.0:1789672703.241541:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543367808 00010000:00010000:2.0:1789672703.241590:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 9 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.241651:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 77 00000100:00100000:2.0:1789672703.241663:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+9:2360:x1876607543367808:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672703.241682:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789672703.241720:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789672703.241723:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789672703 00002000:00010000:2.0:1789672703.241726:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789672703 00002000:00010000:2.0:1789672703.241729:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789672703 00010000:00010000:2.0:1789672703.241737:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 9 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.241753:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 9 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.241813:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f4ae349/0x2247cb9491d095ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae0 expref: 9 pid: 6684 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.241836:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672703.241842:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672703.241849:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.241885:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.241921:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672703.242228:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242241:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242274:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242285:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242296:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242304:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672703.242317:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242330:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242345:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.242354:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b571e0/0x2247cb9491d095ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.242662:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+8:2360:x1876607543367808:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 999us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.242672:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 77 00000100:00100000:3.0:1789672703.242770:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543367552:12345-192.168.202.39@tcp:1:lfs.0 Request processed in 11064us (11372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672703.242823:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:0.0:1789672703.245664:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.245826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543368064 00000100:00100000:3.0:1789672703.245840:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543368064 00000100:00100000:3.0:1789672703.245913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 56 00000100:00100000:3.0:1789672703.245926:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+43:11573:x1876607543368064:12345-192.168.202.39@tcp:35:lfs.0 00000004:00010000:3.0:1789672703.246010:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d095de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaf5 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672703.246617:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789672703.246669:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789672703.251692:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789672703.251936:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.251985:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.251996:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.252047:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.252066:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 47 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.252356:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876607564327296:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672703.252527:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672703.257425:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.257620:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543368192 00000100:00100000:2.0:1789672703.257631:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543368192 00010000:00010000:2.0:1789672703.257685:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.258000:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 78 00000100:00100000:2.0:1789672703.258013:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+48:2357:x1876607543368192:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672703.258034:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672703.258043:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.258059:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.258205:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:2.0:1789672703.258213:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.258228:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.258255:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.258281:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672703.260365:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+48:2357:x1876607543368192:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 346us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.260399:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 78 00010000:00010000:3.0:1789672703.261309:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfad2 expref: 47 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.261339:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1876607564327296:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672703.261370:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.261382:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.261388:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672703.262018:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789672703.262350:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789672703.263695:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564327424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789672703.264253:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672703.264366:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672703.264529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564327424 00000100:00100000:1.0:1789672703.264541:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564327424 00000100:00100000:1.0:1789672703.264705:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789672703.264717:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876607564327424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789672703.265018:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876607564327424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 302us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672703.265027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672703.265132:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564327424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789672703.265753:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789672703.266226:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564327552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789672703.266286:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672703.267034:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672703.267208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564327552 00000100:00100000:3.0:1789672703.267219:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564327552 00000100:00100000:2.0:1789672703.267339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672703.267350:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876607564327552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789672703.268017:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1876607564327552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 664us (1726us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789672703.268028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672703.268329:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1876607564327552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789672703.268492:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1789672703.268555:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.268569:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.268579:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.268586:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672703.268667:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.268678:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.268698:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:0.0:1789672703.268702:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789672703.268708:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.268715:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d095f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672703.269322:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789672703.269518:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789672703.269534:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372050747771ns, next at 373050744651ns, rc = 0 00000001:00080000:0.0:1789672703.269544:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789672703.269588:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa611330800) 00010000:00010000:0.0:1789672703.269592:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789672703.269675:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f200/0x2247cb9491d095de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaf5 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672703.270213:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+50:11573:x1876607543368064:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 24288us (24560us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789672703.270225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 56 00000020:00080000:0.0:1789672703.270233:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789672703.274292:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.274397:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543368320 00000100:00100000:2.0:1789672703.274411:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543368320 00000100:00100000:2.0:1789672703.274588:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 202 00000100:00100000:2.0:1789672703.274610:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+50:11573:x1876607543368320:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672703.274656:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672703.274690:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d095fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfafc expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.275001:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d095fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfafc expref: 51 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.275025:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d095fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfafc expref: 51 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.275070:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.275074:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672703.275090:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fa00, rc 0) 00000100:00100000:2.0:1789672703.275175:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+51:11573:x1876607543368320:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 576us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.275182:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 202 00000100:00100000:0.0:1789672703.279383:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672703.279547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543368576 00000100:00100000:1.0:1789672703.279561:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543368576 00000100:00100000:1.0:1789672703.279733:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:1.0:1789672703.279745:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+51:11573:x1876607543368576:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672703.280286:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+52:11573:x1876607543368576:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 540us (913us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789672703.280295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 57 00000100:00100000:0.0:1789672703.365021:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.365139:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543368704 00000100:00100000:2.0:1789672703.365154:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543368704 00000100:00100000:2.0:1789672703.365231:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 203 00000100:00100000:2.0:1789672703.365245:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+52:11583:x1876607543368704:12345-192.168.202.39@tcp:34:lfs.0 00010000:00010000:2.0:1789672703.365354:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365378:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365394:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365412:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365420:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365437:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365563:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365580:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365588:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672703.365660:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365676:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365683:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365690:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365697:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.365702:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365722:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365738:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672703.365741:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.365747:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365755:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365780:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365862:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365868:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365873:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.365876:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365883:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365892:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa602b49800) 00010000:00010000:2.0:1789672703.365895:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.365898:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365921:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365928:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365935:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365947:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.365950:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365956:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365964:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.365966:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.365969:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.365974:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0960f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.366076:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+52:11583:x1876607543368704:12345-192.168.202.39@tcp:34:lfs.0 Request processed in 832us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.366085:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 203 00000100:00100000:2.0:1789672703.412928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.413506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543368960 00000100:00100000:3.0:1789672703.413521:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543368960 00000100:00100000:3.0:1789672703.413613:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 204 00000100:00100000:3.0:1789672703.413627:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+52:11586:x1876607543368960:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672703.413657:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672703.413689:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb03 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.414639:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.414669:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.414686:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.414704:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.414712:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.414720:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415134:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415145:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415154:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672703.415168:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789672703.415304:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415313:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415322:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415329:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672703.415335:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415343:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415358:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:3.0:1789672703.415366:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672703.415372:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415392:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0961d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415412:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415419:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415425:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415430:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672703.415434:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415440:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415448:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa611330200) 00010000:00010000:3.0:1789672703.415451:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672703.415453:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415459:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c200/0x2247cb9491d09624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415517:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415534:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.415550:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:3.0:1789672703.415552:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672703.415556:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ca00, rc 0) 00000100:00100000:3.0:1789672703.415661:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+54:11586:x1876607543368960:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 2036us (2747us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789672703.415672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 204 00000100:00100000:0.0:1789672703.424635:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.424752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543369088 00000100:00100000:2.0:1789672703.424767:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543369088 00000100:00100000:2.0:1789672703.424888:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 205 00000100:00100000:2.0:1789672703.424900:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+54:11586:x1876607543369088:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:2.0:1789672703.424993:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425014:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425052:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425089:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425098:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425105:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425112:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.425118:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425127:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425142:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.425145:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672703.425152:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.425159:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.425259:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+54:11586:x1876607543369088:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 360us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.425268:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 205 00000100:00100000:0.0:1789672703.428298:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.429584:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543369344 00000100:00100000:3.0:1789672703.429614:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543369344 00000100:00100000:3.0:1789672703.429703:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 58 00000100:00100000:3.0:1789672703.429716:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+54:11586:x1876607543369344:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:2.0:1789672703.430928:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+55:11586:x1876607543369344:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 1204us (2637us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789672703.430957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 58 00000100:00100000:3.0:1789672703.501209:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.501475:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543369600 00000100:00100000:2.0:1789672703.501490:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543369600 00000100:00100000:2.0:1789672703.501571:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 206 00000100:00100000:2.0:1789672703.501584:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+55:11596:x1876607543369600:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672703.501631:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672703.501635:0:7918:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789672703.501674:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d095bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfae7 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.501700:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672703.501706:0:7918:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672703.501724:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09640 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb0a expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.501938:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.501957:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.501968:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.502014:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.502032:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 55 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.502069:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f34b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564327680:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672703.502181:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672703.506085:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.506174:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543369728 00000100:00100000:3.0:1789672703.506188:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543369728 00000100:00100000:2.0:1789672703.506212:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f34b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564327680:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672703.506236:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 56 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.506244:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.506291:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:3.0:1789672703.506302:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+56:2358:x1876607543369728:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672703.506322:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672703.506329:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 56 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.506343:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 56 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.506396:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0962b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb03 expref: 56 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.506415:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:3.0:1789672703.506421:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.506443:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.506454:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.506484:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672703.506554:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+55:2358:x1876607543369728:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 252us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672703.506563:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 79 00010000:00010000:2.0:1789672703.507890:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.507909:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672703.507940:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789672703.508182:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d09640 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 56 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.508206:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 55 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.508216:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.508218:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672703.508221:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f600, rc 0) 00000100:00100000:2.0:1789672703.508284:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+55:11596:x1876607543369600:12345-192.168.202.39@tcp:101:bash.0 Request processed in 6701us (7089us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789672703.508294:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 206 00000100:00100000:0.0:1789672703.515991:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.516159:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543369984 00000100:00100000:2.0:1789672703.516196:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543369984 00000100:00100000:2.0:1789672703.516263:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 207 00000100:00100000:2.0:1789672703.516276:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+55:11596:x1876607543369984:12345-192.168.202.39@tcp:36:bash.0 00010000:00010000:2.0:1789672703.516673:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.516698:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.516714:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672703.516777:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789672703.516845:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a71e90e reply state 0000000096d30a45 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.516857:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672703.517194:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+58:11596:x1876607543369984:12345-192.168.202.39@tcp:36:bash.0 Request processed in 916us (1213us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789672703.517203:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 207 00000020:00080000:2.0:1789672703.517211:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789672703.522613:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.522639:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.522648:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.522655:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.522661:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.522692:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.522715:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.522719:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.522725:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.522732:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672703.523407:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.523573:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543370112 00000100:00100000:3.0:1789672703.523587:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543370112 00000100:00100000:3.0:1789672703.523670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 208 00000100:00100000:3.0:1789672703.523682:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+57:11596:x1876607543370112:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:3.0:1789672703.523713:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672703.523737:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0965c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb11 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.523989:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.524021:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 58 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.524030:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.524074:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 58 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.524090:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 58 pid: 7918 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.524107:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f379880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564327808:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672703.524213:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e8db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672703.527088:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672703.527223:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543370240 00000100:00100000:1.0:1789672703.527236:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543370240 00010000:00010000:1.0:1789672703.527321:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 59 pid: 7918 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672703.527371:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:1.0:1789672703.527383:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+59:2357:x1876607543370240:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672703.527401:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672703.527410:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 59 pid: 7918 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.527427:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 59 pid: 7918 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.527455:0:11163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672703.527462:0:11163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.527474:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.527483:0:11163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.527518:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672703.527584:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+59:2357:x1876607543370240:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 202us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672703.527593:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 80 00010000:00010000:3.0:1789672703.530723:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d09647 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb0a expref: 58 pid: 7918 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.530757:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f379880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564327808:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672703.530837:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.530850:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.530857:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672703.530928:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789672703.530960:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672703.530992:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.531039:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67ca00/0x2247cb9491d0965c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.531058:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.531068:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:3.0:1789672703.531072:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672703.531076:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d600, rc 0) 00000100:00100000:3.0:1789672703.531167:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+57:11596:x1876607543370112:12345-192.168.202.39@tcp:101:bash.0 Request processed in 7486us (7765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672703.531177:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 208 00000100:00100000:0.0:1789672703.536358:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.536467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543370496 00000100:00100000:2.0:1789672703.536481:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543370496 00000100:00100000:2.0:1789672703.536556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:2.0:1789672703.536569:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+57:11596:x1876607543370496:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:2.0:1789672703.536954:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+58:11596:x1876607543370496:12345-192.168.202.39@tcp:35:bash.0 Request processed in 385us (609us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789672703.536964:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 59 00000100:00100000:1.0:1789672703.619010:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672703.619550:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543370624 00000100:00100000:0.0:1789672703.619566:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543370624 00000100:00100000:0.0:1789672703.619662:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 209 00000100:00100000:0.0:1789672703.619674:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+58:11602:x1876607543370624:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672703.619712:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672703.619741:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d0966a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb18 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.619858:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.619878:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.619893:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672703.619941:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789672703.619946:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672703.619968:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.619999:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d0966a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb18 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.620043:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb18 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.620053:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672703.620057:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672703.620062:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911600, rc 0) 00000100:00100000:0.0:1789672703.620150:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+59:11602:x1876607543370624:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 478us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672703.620159:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 209 00000100:00100000:0.0:1789672703.624393:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.624511:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543370752 00000100:00100000:2.0:1789672703.624526:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543370752 00000100:00100000:2.0:1789672703.624617:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 210 00000100:00100000:2.0:1789672703.624632:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+59:11602:x1876607543370752:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672703.624673:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672703.624709:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb1f expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.624864:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.624907:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.624922:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.624942:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.624951:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.624958:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625084:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625094:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625102:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672703.625154:0:7918:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789672703.625160:0:7918:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672703.625184:0:7918:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625198:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625221:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625228:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625237:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625244:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.625249:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625257:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625273:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672703.625277:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.625283:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625291:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d0967f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625309:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625316:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625323:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625334:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fc00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672703.625337:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625344:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625353:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa602b49800) 00010000:00010000:2.0:1789672703.625356:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672703.625360:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625366:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d09686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625406:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb1f expref: 61 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625423:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb1f expref: 60 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.625433:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.625436:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672703.625438:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fe00, rc 0) 00000100:00100000:2.0:1789672703.625518:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+60:11602:x1876607543370752:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 890us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.625528:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 210 00000100:00100000:3.0:1789672703.631561:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.631641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672703.631676:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371008 00000100:00100000:0.0:1789672703.631692:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371008 00000100:00100000:0.0:1789672703.631770:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 211 00000100:00100000:0.0:1789672703.631782:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+60:11602:x1876607543371008:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672703.631855:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672703.631885:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09694 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb26 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672703.631903:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371136 00000100:00100000:1.0:1789672703.631909:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371136 00000100:00100000:1.0:1789672703.631975:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:1.0:1789672703.631983:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+62:2358:x1876607543371136:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672703.631995:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672703.632021:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0968d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb1f expref: 62 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.632026:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.632221:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.632234:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.634403:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672703.634423:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.634438:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672703.634447:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672703.635494:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7225c799-181e-4570-897c-b66842e45960+61:2358:x1876607543371136:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 3498us (3839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672703.635510:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00010000:00010000:0.0:1789672703.636369:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.636400:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 60 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672703.636424:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa609f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564327936:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672703.636551:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789672703.639686:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa609f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1876607564327936:192.168.202.39@tcp:104: 00010000:00010000:0.0:1789672703.639737:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672703.644083:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.644521:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371264 00000100:00100000:2.0:1789672703.644555:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371264 00010000:00010000:2.0:1789672703.644623:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 61 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672703.644687:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:2.0:1789672703.644699:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+61:2358:x1876607543371264:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672703.644720:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672703.644729:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 61 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.644747:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 61 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.644775:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb11 expref: 61 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.645024:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.645031:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.645043:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.645053:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.645087:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672703.645112:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.645123:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672703.645148:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1789672703.645158:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+60:2358:x1876607543371264:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 460us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.645178:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 81 00010000:00010000:0.0:1789672703.645375:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09694 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.645394:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.645401:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672703.645404:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672703.645414:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911c00, rc 0) 00000100:00100000:0.0:1789672703.645448:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+60:11602:x1876607543371008:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 13669us (13905us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789672703.645456:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 211 00000100:00100000:1.0:1789672703.648774:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672703.649051:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371520 00000100:00100000:3.0:1789672703.649065:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371520 00000100:00100000:3.0:1789672703.649151:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:3.0:1789672703.649163:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+60:11602:x1876607543371520:12345-192.168.202.39@tcp:103:lfs.0 00010000:00010000:3.0:1789672703.649184:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672703.649217:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d095fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfafc expref: 60 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672703.649253:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:3.0:1789672703.649278:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672703.649355:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+59:11602:x1876607543371520:12345-192.168.202.39@tcp:103:lfs.0 Request processed in 193us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672703.649363:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:3.0:1789672703.653660:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672703.653946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371648 00000100:00100000:0.0:1789672703.653962:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371648 00000100:00100000:0.0:1789672703.654048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 212 00000100:00100000:0.0:1789672703.654060:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+59:11602:x1876607543371648:12345-192.168.202.39@tcp:58:lfs.0 00010000:00010000:0.0:1789672703.654239:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.654263:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672703.654286:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672703.654613:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789672703.654943:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+59:11602:x1876607543371648:12345-192.168.202.39@tcp:58:lfs.0 Request processed in 882us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672703.654953:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 212 00000100:00100000:0.0:1789672703.658400:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672703.658522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371776 00000100:00100000:2.0:1789672703.658537:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371776 00000100:00100000:2.0:1789672703.658624:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 213 00000100:00100000:2.0:1789672703.658636:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+59:11602:x1876607543371776:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672703.658675:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672703.658705:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb2d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.658993:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.659009:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.659035:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.659052:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.659068:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672703.659072:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672703.659075:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672703.659083:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fc00, rc 0) 00000100:00100000:2.0:1789672703.659188:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+60:11602:x1876607543371776:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 552us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672703.659196:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 213 00000040:00080000:0.0:1789672704.115200:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672704.115212:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672704.115256:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789672704.115263:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672704.115437:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b31500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564328064:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672704.115672:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672704.121144:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672704.121260:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543371904 00000100:00100000:3.0:1789672704.121274:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543371904 00000100:00100000:2.0:1789672704.121320:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b31500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564328064:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1789672704.121412:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672704.121489:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 214 00000100:00100000:3.0:1789672704.121499:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+60:11603:x1876607543371904:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789672704.121534:0:7918:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789672704.121662:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+60:11603:x1876607543371904:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 165us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.121667:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 214 00000100:00100000:2.0:1789672704.129146:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.129278:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543372032 00000100:00100000:0.0:1789672704.129294:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543372032 00000100:00100000:0.0:1789672704.129379:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 215 00000100:00100000:0.0:1789672704.129392:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+60:11603:x1876607543372032:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789672704.129504:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129527:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129543:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129565:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129574:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129581:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129624:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129633:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129758:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672704.129873:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789672704.129948:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672704.129966:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129981:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129990:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.129998:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130006:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672704.130011:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130021:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130038:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672704.130042:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672704.130048:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130056:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d096b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130072:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130090:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130098:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130104:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672704.130107:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130114:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130122:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9fa610c05600) 00010000:00010000:0.0:1789672704.130125:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672704.130128:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130134:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d096be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130155:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130162:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130168:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130173:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672704.130183:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130189:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130198:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672704.130201:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672704.130204:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.130212:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d096c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.130322:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+60:11603:x1876607543372032:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 Request processed in 930us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.130333:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 215 00000100:00100000:0.0:1789672704.136009:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.136121:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543372288 00000100:00100000:1.0:1789672704.136135:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543372288 00000100:00100000:1.0:1789672704.136204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 216 00000100:00100000:1.0:1789672704.136216:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+60:11603:x1876607543372288:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672704.136245:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672704.136273:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d096cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb34 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136420:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136464:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136480:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672704.136496:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789672704.136639:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136649:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136657:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136663:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672704.136668:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136677:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136691:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672704.136695:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672704.136702:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136709:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.136759:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d096cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb34 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.137048:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:1.0:1789672704.137050:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672704.137056:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d096cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb34 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.137120:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f000, rc 0) 00000100:00100000:1.0:1789672704.137248:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+61:11603:x1876607543372288:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1032us (1253us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1789672704.137257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 216 00000100:00100000:3.0:1789672704.141398:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.141547:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543372416 00000100:00100000:2.0:1789672704.141575:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543372416 00000100:00100000:2.0:1789672704.141661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 217 00000100:00100000:2.0:1789672704.141673:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+61:11603:x1876607543372416:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672704.141724:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672704.141898:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+61:11603:x1876607543372416:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 226us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.141907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 217 00000100:00100000:0.0:1789672704.151938:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.152058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543372672 00000100:00100000:1.0:1789672704.152072:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543372672 00000100:00100000:1.0:1789672704.152151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 218 00000100:00100000:1.0:1789672704.152164:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+61:11603:x1876607543372672:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672704.152197:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672704.152201:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789672704.152240:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911600/0x2247cb9491d09671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb18 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.152266:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:1.0:1789672704.152273:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672704.152292:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d096e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb3b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672704.153616:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789672704.154478:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.154513:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.154526:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.155503:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d096e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb3b expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.155538:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb3b expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.155548:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa6184b6c00) 00010000:00010000:1.0:1789672704.155551:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672704.155555:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672704.155673:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+62:11603:x1876607543372672:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 3510us (3748us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789672704.155686:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 218 00000100:00100000:3.0:1789672704.165218:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.165358:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543372928 00000100:00100000:2.0:1789672704.165375:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543372928 00000100:00100000:2.0:1789672704.165465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 219 00000100:00100000:2.0:1789672704.165477:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+62:11603:x1876607543372928:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789672704.165563:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672704.165610:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d096e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb3b expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.165636:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa6184b6c00) 00010000:00010000:2.0:1789672704.165654:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672704.165689:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.165720:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.165746:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.165765:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166066:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166077:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166162:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166170:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166176:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166183:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672704.166188:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166197:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166205:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672704.166208:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672704.166213:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166227:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929ec00/0x2247cb9491d096f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166238:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166244:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166249:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166254:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672704.166257:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166262:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166269:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8a6420b4 (ffff9fa602b49800) 00010000:00010000:2.0:1789672704.166271:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672704.166273:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.166278:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fa00/0x2247cb9491d096fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8a6420b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.166401:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+61:11603:x1876607543372928:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 925us (1200us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672704.166411:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 219 00000100:00100000:3.0:1789672704.169356:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.170118:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543373056 00000100:00100000:2.0:1789672704.170134:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543373056 00000100:00100000:2.0:1789672704.170331:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 220 00000100:00100000:2.0:1789672704.170344:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+61:11603:x1876607543373056:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672704.170371:0:7918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672704.170403:0:7918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09704 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb42 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.170448:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.170464:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.170478:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.170629:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f400/0x2247cb9491d09704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 63 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.170650:0:7918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 62 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.170660:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:2.0:1789672704.170663:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672704.170672:0:7918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fe00, rc 0) 00000100:00100000:2.0:1789672704.170944:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+62:11603:x1876607543373056:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 602us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.170953:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 220 00000100:00100000:3.0:1789672704.173918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.175063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543373312 00000100:00100000:1.0:1789672704.175088:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543373312 00000100:00100000:1.0:1789672704.175172:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 221 00000100:00100000:1.0:1789672704.175186:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+62:11603:x1876607543373312:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672704.175305:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.175477:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.175516:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672704.175945:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789672704.175957:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372957170320ns, next at 373957167696ns, rc = 0 00000004:00010000:1.0:1789672704.176134:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc715a39 reply state 00000000942e3eda transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672704.176145:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672704.176340:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+64:11603:x1876607543373312:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 1155us (2432us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789672704.176351:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 221 00010000:00010000:3.0:1789672704.183230:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.183256:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.183266:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.183273:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672704.183278:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.183305:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672704.183526:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:3.0:1789672704.184123:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:3.0:1789672704.184129:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789672704.184137:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.184146:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f000/0x2247cb9491d09712 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672704.184200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543373440 00000100:00100000:3.0:1789672704.184214:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543373440 00000100:00100000:3.0:1789672704.184275:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 222 00000100:00100000:3.0:1789672704.184286:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+63:11603:x1876607543373440:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672704.184453:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672704.184477:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb49 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.184760:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 64 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.184930:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 64 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.184961:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:3.0:1789672704.184964:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672704.184967:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c400, rc 0) 00000100:00100000:3.0:1789672704.185115:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+64:11603:x1876607543373440:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 830us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.185123:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 222 00000100:00100000:1.0:1789672704.188604:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.188700:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543373568 00000100:00100000:2.0:1789672704.188714:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543373568 00000100:00100000:2.0:1789672704.188837:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00100000:2.0:1789672704.188849:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+9:2358:x1876607543373568:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789672704.189247:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+10:2358:x1876607543373568:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 398us (664us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789672704.189255:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00080000:3.0:1789672704.189359:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672704.191992:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.192095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543373824 00000100:00100000:1.0:1789672704.192108:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543373824 00000100:00100000:1.0:1789672704.192176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:1.0:1789672704.192188:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+64:11603:x1876607543373824:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672704.192505:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+65:11603:x1876607543373824:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 319us (525us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789672704.192515:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 60 00000100:00100000:3.0:1789672704.194667:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.194832:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374080 00000100:00100000:0.0:1789672704.194846:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374080 00000100:00100000:0.0:1789672704.194907:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 223 00000100:00100000:0.0:1789672704.194918:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+65:11603:x1876607543374080:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789672704.195067:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+65:11603:x1876607543374080:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 149us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.195086:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 223 00000100:00100000:3.0:1789672704.197499:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.197682:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374208 00000100:00100000:0.0:1789672704.197696:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374208 00000100:00100000:0.0:1789672704.197837:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 224 00000100:00100000:0.0:1789672704.197849:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+65:11603:x1876607543374208:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672704.197882:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672704.197912:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb50 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.198002:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.198019:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.198034:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672704.198091:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672704.198117:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.198148:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb50 expref: 67 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.198168:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb50 expref: 66 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.198177:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:0.0:1789672704.198180:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789672704.198185:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672704.198260:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+66:11603:x1876607543374208:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 414us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.198276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 224 00000100:00100000:3.0:1789672704.201130:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.201683:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374336 00000100:00100000:1.0:1789672704.201698:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374336 00000100:00100000:1.0:1789672704.202036:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:1.0:1789672704.202050:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+10:2360:x1876607543374336:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672704.202087:0:8063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672704.202133:0:8063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb57 expref: -99 pid: 8063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672704.202171:0:8063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3d00, blocks: 0x1 00010000:00010000:1.0:1789672704.202195:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789672704.202200:0:8063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672704.202212:0:8063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 11 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.202235:0:8063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 11 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.202251:0:8063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e200, rc 0) 00000100:00100000:1.0:1789672704.202442:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7225c799-181e-4570-897c-b66842e45960+11:2360:x1876607543374336:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 394us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672704.202451:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:2.0:1789672704.205293:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.205453:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374592 00000100:00100000:0.0:1789672704.205468:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374592 00000100:00100000:0.0:1789672704.205573:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 225 00000100:00100000:0.0:1789672704.205585:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+66:11603:x1876607543374592:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789672704.205743:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+66:11603:x1876607543374592:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 159us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.205751:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 225 00000100:00100000:3.0:1789672704.208107:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.208235:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374720 00000100:00100000:2.0:1789672704.208248:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374720 00000100:00100000:2.0:1789672704.208331:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:2.0:1789672704.208343:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+11:11603:x1876607543374720:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672704.208368:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672704.208395:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb5e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.208441:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.208453:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672704.208458:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672704.208465:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.208513:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.208555:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.208572:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f34bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564328192:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672704.208700:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672704.210509:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f34bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1876607564328192:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672704.210548:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.210574:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f400, rc 0) 00000100:00100000:3.0:1789672704.210648:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+12:11603:x1876607543374720:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 2307us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.210659:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:2.0:1789672704.212251:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672704.212927:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374848 00000100:00100000:3.0:1789672704.212941:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374848 00010000:00010000:3.0:1789672704.212995:0:11163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672704.213045:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 82 00000100:00100000:3.0:1789672704.213056:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+12:2358:x1876607543374848:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672704.213092:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672704.213124:0:11163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.213163:0:11163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.213194:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a835d10b/0x2247cb9491d0972e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb57 expref: 12 pid: 8063 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.213215:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672704.213219:0:11163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672704.213228:0:11163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.213239:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.213286:0:11163:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672704.213307:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11163:1876607564328320:192.168.202.39@tcp:105: 00000100:00100000:3.0:1789672704.213528:0:11163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672704.216990:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11163:1876607564328320:192.168.202.39@tcp:105: 00010000:00010000:1.0:1789672704.217030:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672704.217112:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7225c799-181e-4570-897c-b66842e45960+11:2358:x1876607543374848:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 4056us (4868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672704.217123:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 82 00000100:00100000:1.0:1789672704.220553:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.220680:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543374976 00000100:00100000:0.0:1789672704.220695:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543374976 00002000:00100000:0.0:1789672704.220764:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fa63a22f480 x1876607543374976/t0(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:330/0 lens 504/0 e 0 to 0 dl 1789672715 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672704.220828:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63a22f480 with x1876607543374976 ext(0->12) 00002000:00010000:0.0:1789672704.220836:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa63a22f480 00000100:00100000:0.0:1789672704.220873:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672704.220886:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7225c799-181e-4570-897c-b66842e45960+11:2357:x1876607543374976:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789672704.221731:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7225c799-181e-4570-897c-b66842e45960+13:2357:x1876607543374976:12345-192.168.202.39@tcp:4:lhsmtool_posix.0 Request processed in 841us (1187us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789672704.221742:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00002000:00100000:0.0:1789672704.221753:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fa63a22f480 x1876607543374976/t4294967320(0) o4->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:330/0 lens 504/448 e 0 to 0 dl 1789672715 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672704.221763:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa63a22f480 with x1876607543374976 ext(0->12) 00002000:00010000:0.0:1789672704.221768:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa63a22f480 00000100:00100000:2.0:1789672704.227280:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.227383:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543375104 00000100:00100000:0.0:1789672704.227397:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543375104 00000100:00100000:0.0:1789672704.227467:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 226 00000100:00100000:0.0:1789672704.227479:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+66:11603:x1876607543375104:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1789672704.244268:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789672704.254147:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:1.0:1789672704.254169:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:0.0:1789672704.254307:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+64:11603:x1876607543375104:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 Request processed in 26822us (27035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.254321:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 226 00000100:00100000:0.0:1789672704.254419:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564328448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789672704.254485:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672704.254563:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564328448 00000100:00100000:3.0:1789672704.254584:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564328448 00000100:00100000:3.0:1789672704.254847:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789672704.254860:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876607564328448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789672704.254913:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789672704.254956:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aac3cff, atime: 0x6aac3cff, ctime: 0x6aac3cff, blocks: 0x1 00010000:00010000:3.0:1789672704.254967:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.254987:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1789672704.254992:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672704.255000:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.255021:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.255033:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.255043:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.255066:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672704.255759:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672704.255770:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.255781:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672704.255802:0:8499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.255814:0:8499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.255835:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.255843:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051685cef/0x2247cb9491d0973c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.255884:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672704.255886:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672704.255888:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789672704.255980:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa604a7af00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789672704.255986:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa608bd9300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa604a7a000 00000020:00080000:1.0:1789672704.255996:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa608bd9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa635454000 00000001:00080000:1.0:1789672704.256023:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789672704.256031:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1789672704.256090:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa61a755e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789672704.256093:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa62f448700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa61a755780 00000020:00080000:1.0:1789672704.256096:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa62f448e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa63a21ec00 00000004:00080000:1.0:1789672704.256137:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00080000:0.0:1789672704.256391:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672704.256563:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000020:00080000:2.0:1789672704.256685:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789672704.256907:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789672704.256929:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564328576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789672704.256988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672704.257029:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672704.257037:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564328704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789672704.257042:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543375232 00000100:00100000:0.0:1789672704.257052:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543375232 00000100:00100000:2.0:1789672704.257063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672704.257161:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564328576 00000100:00100000:0.0:1789672704.257167:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564328576 00000100:00100000:0.0:1789672704.257198:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564328704 00000100:00100000:0.0:1789672704.257202:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564328704 00000100:00100000:0.0:1789672704.257224:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:0.0:1789672704.257235:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+13:2357:x1876607543375232:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789672704.257248:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1876607564328448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2389us (2761us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789672704.257258:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789672704.257283:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789672704.257291:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564328576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789672704.257310:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789672704.257347:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.257371:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.257381:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789672704.257386:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672704.257392:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.257428:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.257446:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 13 pid: 6684 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672704.257460:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876607564328832:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672704.257541:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e8dcc0 going to sleep for 11 seconds 00000100:00080000:2.0:1789672704.257771:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789672704.257966:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa62f34aa00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789672704.257976:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f34aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564328448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789672704.260252:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876607564328832:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672704.260302:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672704.262348:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.262612:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543375360 00000100:00100000:0.0:1789672704.262626:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543375360 00010000:00010000:0.0:1789672704.262678:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 14 pid: 6684 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.262734:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 83 00000100:00100000:0.0:1789672704.262747:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+14:2358:x1876607543375360:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672704.262769:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672704.262817:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 14 pid: 6684 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.262833:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 14 pid: 6684 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.262863:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa474291/0x2247cb9491d094fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfabd expref: 14 pid: 6684 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.262884:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672704.262890:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672704.262897:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.262910:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.263054:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672704.263131:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+13:2358:x1876607543375360:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 387us (796us total) trans 0 rc 0/0 00010000:00010000:2.0:1789672704.263140:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.263141:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 83 00010000:00010000:2.0:1789672704.263155:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.263168:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.263177:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.263208:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789672704.264535:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1876607564328576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7239us (7540us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789672704.264548:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1789672704.264900:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa63a22e680/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789672704.264909:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a22e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564328576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789672704.266669:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672704.266692:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564328704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789672704.266951:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789672704.266956:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789672704 00002000:00010000:2.0:1789672704.266959:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789672704.266962:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789672704 -> 1789672704 00002000:00010000:2.0:1789672704.266965:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789672704.267066:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3299:x1876607564328704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 384us (10002us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789672704.267075:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1789672704.267114:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672704.267124:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.267138:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672704.267144:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.267157:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.267203:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.267212:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09743 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.267234:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672704.267236:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672704.267238:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789672704.267287:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa635640380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789672704.267383:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564328704:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789672704.360196:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789672704.360225:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:1.0:1789672704.360707:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543375232:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 Request processed in 103461us (104135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672704.360724:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:1.0:1789672704.368059:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.369206:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543375616 00000100:00100000:0.0:1789672704.369225:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543375616 00000100:00100000:0.0:1789672704.369313:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 227 00000100:00100000:0.0:1789672704.369327:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+20:11603:x1876607543375616:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672704.369427:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672704.369463:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb50 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.369489:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:0.0:1789672704.369495:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672704.369538:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.369557:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.369968:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672704.370326:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f050df60 reply state 00000000bad252d4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.370338:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672704.370480:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+21:11603:x1876607543375616:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 1155us (2437us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789672704.370489:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 227 00010000:00010000:3.0:1789672704.375395:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.375434:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.375468:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.375475:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672704.375482:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.375492:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.375516:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:3.0:1789672704.375520:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672704.375525:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.375532:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d0974a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672704.376680:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672704.377150:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543375744 00000100:00100000:3.0:1789672704.377166:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543375744 00000100:00100000:3.0:1789672704.377238:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:3.0:1789672704.377250:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61db56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2358:x1876607543375744:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789672704.377553:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789672704.377558:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789672704 -> 1789672704 00002000:00010000:3.0:1789672704.377560:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789672703 00002000:00010000:3.0:1789672704.377562:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789672704 -> 1789672704 00002000:00010000:3.0:1789672704.377565:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789672704.377818:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61db56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+8:2358:x1876607543375744:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 568us (1147us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789672704.377844:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:1.0:1789672704.383685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.384103:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376000 00000100:00100000:0.0:1789672704.384123:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376000 00000100:00100000:0.0:1789672704.384234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 228 00000100:00100000:0.0:1789672704.384247:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+20:11603:x1876607543376000:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789672704.384348:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.384389:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 20 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.384399:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.384444:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 20 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.384458:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 20 pid: 7918 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.384476:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564328960:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672704.384651:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672704.399432:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1876607564328960:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672704.399473:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672704.399768:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.407396:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376128 00000100:00100000:2.0:1789672704.407423:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376128 00010000:00010000:2.0:1789672704.407495:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 21 pid: 7918 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.407552:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:2.0:1789672704.407563:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+21:2358:x1876607543376128:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672704.407584:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672704.407602:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 21 pid: 7918 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.407620:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 21 pid: 7918 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.407674:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d0970b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb42 expref: 21 pid: 7918 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.407695:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:2.0:1789672704.407701:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.407713:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.407722:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.407757:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672704.408024:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408035:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408075:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408082:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408089:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408109:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672704.408114:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408123:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408133:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:0.0:1789672704.408147:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789672704.408151:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.408157:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09751 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.408283:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+20:11603:x1876607543376000:12345-192.168.202.39@tcp:55:lhsmtool_posix.0 Request processed in 24038us (24613us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789672704.408293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 228 00000100:00100000:2.0:1789672704.409030:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+19:2358:x1876607543376128:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 1461us (9258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.409041:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:1.0:1789672704.413095:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.413237:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376256 00000100:00100000:2.0:1789672704.413252:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376256 00000100:00100000:2.0:1789672704.413326:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:2.0:1789672704.413337:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543376256:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789672704.413399:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.413434:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.413466:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789672704.413472:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672704.413477:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.413521:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.413538:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 8 pid: 6685 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.413559:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f349f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876607564329088:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672704.413680:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672704.417705:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f349f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1876607564329088:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672704.417750:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672704.418612:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.418837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376384 00000100:00100000:0.0:1789672704.418849:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376384 00010000:00010000:0.0:1789672704.418905:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 9 pid: 6685 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.418955:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 85 00000100:00100000:0.0:1789672704.418966:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+9:2357:x1876607543376384:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672704.418986:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672704.419018:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 9 pid: 6685 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.419056:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 9 pid: 6685 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.419087:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09735 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb5e expref: 9 pid: 6685 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.419109:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672704.419115:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672704.419122:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.419134:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.419186:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672704.419269:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543376384:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 303us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.419277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 85 00010000:00010000:2.0:1789672704.419678:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419692:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419727:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419746:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419754:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419763:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672704.419781:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419847:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419862:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.419871:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09758 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.419939:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543376256:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 Request processed in 6602us (7151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.419948:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 70 00000100:00100000:0.0:1789672704.426727:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.426943:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376640 00000100:00100000:2.0:1789672704.426956:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376640 00000100:00100000:2.0:1789672704.427041:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 229 00000100:00100000:2.0:1789672704.427088:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+19:11603:x1876607543376640:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789672704.427221:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427246:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427261:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427566:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427580:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427605:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427654:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.427671:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.427689:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f349f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564329216:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672704.432741:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672704.434698:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.438523:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376768 00000100:00100000:1.0:1789672704.438547:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376768 00010000:00010000:1.0:1789672704.438647:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 21 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672704.438706:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 86 00000100:00100000:1.0:1789672704.438717:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+21:2357:x1876607543376768:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672704.438758:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672704.438767:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 21 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.438783:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 21 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.438852:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:1.0:1789672704.438860:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.438871:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.438880:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.438906:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672704.439140:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb49 expref: 21 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.439180:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f349f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564329216:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672704.439207:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.439218:0:7918:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.439225:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672704.439483:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1789672704.439688:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1789672704.439743:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1789672704.439894:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f349f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564329344:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789672704.439969:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672704.440008:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672704.440340:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+23:2357:x1876607543376768:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 1620us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672704.440351:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 86 00000100:00100000:2.0:1789672704.440532:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564329344 00000100:00100000:2.0:1789672704.440541:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564329344 00000100:00100000:2.0:1789672704.443913:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672704.443951:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7918:x1876607564329344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789672704.444141:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7918:x1876607564329344:12345-0@lo:1000:mdt00_003.0 Request processed in 211us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.444151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789672704.444398:0:7918:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1789672704.444407:0:7918:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1789672704.444448:0:7918:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9fa63a22e680 x1876607564328576/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789672720 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672704.444471:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f349f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564329344:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789672704.445307:0:7918:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789672704.445440:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f526300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564329472:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789672704.445531:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672704.445571:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672704.446222:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564329472 00000100:00100000:1.0:1789672704.446239:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564329472 00000100:00100000:1.0:1789672704.446310:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789672704.446320:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7918:x1876607564329472:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789672704.446679:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7918:x1876607564329472:12345-0@lo:1000:mdt00_003.0 Request processed in 359us (1147us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789672704.446688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789672704.447880:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f526300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7918:1876607564329472:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789672704.447946:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.447958:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.447967:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.447975:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672704.447980:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.447988:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448025:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa602b49a00) 00010000:00010000:3.0:1789672704.448028:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672704.448035:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448042:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fe00/0x2247cb9491d09766 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448085:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448092:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448098:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448104:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672704.448107:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448113:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448122:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:3.0:1789672704.448125:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672704.448133:0:7918:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448147:0:7918:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448166:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.448214:0:7918:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672704.448231:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564329600:192.168.202.39@tcp:105: 00000100:00100000:3.0:1789672704.448329:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa624e8d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789672704.457393:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.459706:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7918:1876607564329600:192.168.202.39@tcp:105: 00010000:00010000:2.0:1789672704.459757:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459863:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910800/0x2247cb9491d096a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459916:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459935:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459949:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459964:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459972:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459979:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459985:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672704.459989:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.459997:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460009:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672704.460013:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672704.460018:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460032:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f000/0x2247cb9491d0976d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460045:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460052:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460059:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460064:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672704.460067:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460073:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460081:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672704.460083:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672704.460087:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.460093:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929f600/0x2247cb9491d0975f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.460420:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+23:11603:x1876607543376640:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 33335us (33707us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789672704.460434:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 229 00000020:00080000:2.0:1789672704.460449:0:7918:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789672704.460892:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672704.460900:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672704.461396:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789672704.461407:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672704.462042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543376896 00000100:00100000:1.0:1789672704.462057:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543376896 00000100:00100000:1.0:1789672704.462132:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:1.0:1789672704.462156:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+23:11602:x1876607543376896:12345-192.168.202.39@tcp:49:lfs.0 00000100:00100000:1.0:1789672704.462329:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+23:11602:x1876607543376896:12345-192.168.202.39@tcp:49:lfs.0 Request processed in 176us (4952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672704.462337:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 61 00000100:00100000:3.0:1789672704.463515:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.463603:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543377152 00000100:00100000:1.0:1789672704.463612:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543377152 00000100:00100000:1.0:1789672704.463661:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 62 00000100:00100000:1.0:1789672704.463671:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+23:11603:x1876607543377152:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789672704.464451:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672704.464999:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543377408 00000100:00100000:2.0:1789672704.465009:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543377408 00000100:00100000:2.0:1789672704.465058:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 230 00000100:00100000:2.0:1789672704.465067:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+24:11602:x1876607543377408:12345-192.168.202.39@tcp:58:lfs.0 00000040:00080000:2.0:1789672704.465554:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789672704.466395:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+25:11602:x1876607543377408:12345-192.168.202.39@tcp:58:lfs.0 Request processed in 1322us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.466408:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 230 00000004:00080000:1.0:1789672704.467277:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789672704.467493:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789672704.467579:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.467617:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.467635:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.467646:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.467653:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.467659:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672704.467693:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672704.467846:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+25:11603:x1876607543377152:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 4174us (4335us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789672704.467857:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 62 00000020:00080000:1.0:1789672704.467864:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789672704.468162:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672704.468172:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.468181:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672704.468196:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.468206:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.468222:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:3.0:1789672704.468226:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789672704.468231:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.468238:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e400/0x2247cb9491d09774 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672704.468269:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672704.468271:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672704.468273:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672704.520650:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.520918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543377536 00000100:00100000:0.0:1789672704.520933:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543377536 00000100:00100000:0.0:1789672704.521024:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 231 00000100:00100000:0.0:1789672704.521052:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+25:11605:x1876607543377536:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672704.521090:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672704.521118:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d0977b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb65 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521212:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521233:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521249:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521267:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521275:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521283:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521601:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521616:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521627:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521680:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.521698:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 26 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.521716:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564329728:192.168.202.39@tcp:104: 00000100:00100000:0.0:1789672704.521898:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672704.533543:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672704.533693:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1876607564329728:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672704.533732:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672704.533873:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543377792 00000100:00100000:2.0:1789672704.533884:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543377792 00000100:00100000:2.0:1789672704.533954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:2.0:1789672704.533967:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+27:5596:x1876607543377792:12345-192.168.202.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789672704.534516:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+28:5596:x1876607543377792:12345-192.168.202.39@tcp:35:ldlm_bl.0 Request processed in 549us (985us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789672704.534526:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 63 00000100:00100000:3.0:1789672704.547172:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672704.547382:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543377920 00000100:00100000:0.0:1789672704.547396:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543377920 00010000:00010000:0.0:1789672704.547453:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 28 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672704.547503:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:0.0:1789672704.547514:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+28:2358:x1876607543377920:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672704.547534:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672704.547543:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 28 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.547559:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 28 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.547586:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911c00/0x2247cb9491d0969b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb26 expref: 28 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.547643:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672704.547650:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.547662:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.547672:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672704.547923:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672704.547990:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7225c799-181e-4570-897c-b66842e45960+27:2358:x1876607543377920:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 477us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.547999:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 87 00010000:00010000:2.0:1789672704.551027:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.551054:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672704.551125:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789672704.551131:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672704.551162:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.551182:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.551223:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.551230:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.551999:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552007:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672704.552012:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552022:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552042:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:2.0:1789672704.552045:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672704.552051:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552482:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910a00/0x2247cb9491d09782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552510:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552517:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552524:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552542:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911e00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672704.552546:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552552:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552562:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa610c05c00) 00010000:00010000:2.0:1789672704.552564:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672704.552568:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552574:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911e00/0x2247cb9491d09789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552654:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d0977b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb65 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552672:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb65 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672704.552679:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:2.0:1789672704.552682:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672704.552685:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911200, rc 0) 00000100:00100000:2.0:1789672704.553889:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+26:11605:x1876607543377536:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 31733us (32146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.553913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 231 00000100:00100000:0.0:1789672704.949826:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564329856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672704.949891:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564330112:0@lo:400:kworker.0 00000100:00100000:0.0:1789672704.949929:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672704.949943:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672704.950297:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672704.950307:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564330240:0@lo:400:kworker.0 00000100:00100000:3.0:1789672704.950314:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564329856 00000100:00100000:3.0:1789672704.950326:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564329856 00000100:00100000:1.0:1789672704.950341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672704.950397:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789672704.950410:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3301:x1876607564329856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672704.950439:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789672704.950493:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3301:x1876607564329856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.950502:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789672704.950549:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564330112 00000100:00100000:3.0:1789672704.950554:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564330112 00000100:00100000:3.0:1789672704.950599:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564330240 00000100:00100000:3.0:1789672704.950603:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564330240 00000100:00100000:3.0:1789672704.950637:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789672704.950644:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564330112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672704.950684:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564330112:12345-0@lo:400:kworker.0 Request processed in 40us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.950691:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789672704.950703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789672704.950709:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564330240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672704.950737:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564330240:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.950752:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1789672704.950769:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672704.950828:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa607b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564329984:0@lo:400:kworker.0 00000100:00100000:3.0:1789672704.950867:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672704.950904:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564329984 00000100:00100000:3.0:1789672704.950908:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564329984 00000100:00100000:3.0:1789672704.950936:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789672704.950943:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564329984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672704.950977:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564329984:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672704.950983:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789672704.951035:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564329984:0@lo:400:kworker.0 00000100:00100000:1.0:1789672704.954134:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564330240:0@lo:400:kworker.0 00000100:00100000:1.0:1789672704.954158:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564330112:0@lo:400:kworker.0 00000100:00100000:0.0:1789672704.964337:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa607b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564329856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672704.964359:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564330368:0@lo:400:kworker.0 00000100:00100000:0.0:1789672704.964439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672704.964664:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564330368 00000100:00100000:2.0:1789672704.964690:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564330368 00000100:00100000:2.0:1789672704.964771:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789672704.964807:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564330368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672704.964870:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564330368:12345-0@lo:400:kworker.0 Request processed in 65us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672704.964877:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1789672704.972555:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672704.972654:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564330368:0@lo:400:kworker.0 00010000:00010000:3.0:1789672705.268182:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672705.433361:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672705.433375:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672705.433430:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789672705.433437:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789672705.523169:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672705.523192:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672705.523245:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789672705.523254:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672705.523547:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa611839880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564330496:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672705.523730:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60691a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672705.532822:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa611839880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1876607564330496:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789672705.534544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672705.539427:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543378048 00000100:00100000:2.0:1789672705.539448:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543378048 00000100:00100000:2.0:1789672705.539538:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 232 00000100:00100000:2.0:1789672705.539553:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+26:11618:x1876607543378048:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672705.539614:0:7918:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672705.539777:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+26:11618:x1876607543378048:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 227us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672705.539816:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 232 00000100:00100000:2.0:1789672705.556746:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672705.556885:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543378304 00000100:00100000:3.0:1789672705.556903:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543378304 00000100:00100000:3.0:1789672705.556974:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 233 00000100:00100000:3.0:1789672705.556983:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+26:11618:x1876607543378304:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672705.557007:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672705.557030:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09797 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb6c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672705.557244:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0979e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672705.557261:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672705.557288:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672705.557303:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789672705.557512:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09797 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb6c expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672705.557535:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0979e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb6c expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672705.557542:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:3.0:1789672705.557545:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672705.557549:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d200, rc 0) 00000100:00100000:3.0:1789672705.557694:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7225c799-181e-4570-897c-b66842e45960+28:11618:x1876607543378304:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 710us (5545us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789672705.557704:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 233 00000100:00100000:2.0:1789672705.562624:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672705.562735:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543378560 00000100:00100000:1.0:1789672705.562750:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543378560 00000100:00100000:1.0:1789672705.562869:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 234 00000100:00100000:1.0:1789672705.562885:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+28:11618:x1876607543378560:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672705.562998:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563023:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563053:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563344:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563354:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563362:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563369:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672705.563375:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563384:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563401:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672705.563405:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672705.563412:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.563419:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672705.564003:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+29:11618:x1876607543378560:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 1118us (1389us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789672705.564016:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 234 00000100:00100000:3.0:1789672705.564683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672705.564856:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543378688 00000100:00100000:1.0:1789672705.564867:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543378688 00000100:00100000:1.0:1789672705.564925:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:1.0:1789672705.564937:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+29:2358:x1876607543378688:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672705.564956:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672705.564980:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d200/0x2247cb9491d0979e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb6c expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672705.564999:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672705.565005:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672705.565043:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7225c799-181e-4570-897c-b66842e45960+28:2358:x1876607543378688:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672705.565051:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00000040:00080000:2.0:1789672705.565080:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672705.565087:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672705.566667:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789672705.566691:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672705.567715:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672705.567976:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543378944 00000100:00100000:1.0:1789672705.567990:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543378944 00000100:00100000:1.0:1789672705.568059:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 64 00000100:00100000:1.0:1789672705.568071:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+28:11618:x1876607543378944:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672705.568510:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+29:11618:x1876607543378944:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 440us (803us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789672705.568519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 64 00010000:00010000:2.0:1789672706.291414:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789672706.631464:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789672706.631491:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789672706.631498:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1789672706.737941:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672706.737985:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672706.738016:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672706.738041:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672706.738103:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672706.738137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379072 00000100:00100000:0.0:1789672706.738150:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379072 00000100:00100000:0.0:1789672706.738213:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 295 00000100:00100000:0.0:1789672706.738226:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543379072:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672706.738320:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543379072:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 96us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672706.738329:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 295 00000100:00100000:0.0:1789672706.738370:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379328 00000100:00100000:0.0:1789672706.738374:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379328 00000100:00100000:0.0:1789672706.738413:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379456 00000100:00100000:0.0:1789672706.738416:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379456 00000100:00100000:0.0:1789672706.738440:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:0.0:1789672706.738447:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543379328:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672706.738499:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543379328:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 52us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672706.738506:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:0.0:1789672706.738520:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:0.0:1789672706.738526:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543379456:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672706.738551:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543379456:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672706.738557:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:0.0:1789672706.738871:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379584 00000100:00100000:0.0:1789672706.738877:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379584 00000100:00100000:0.0:1789672706.738909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379200 00000100:00100000:0.0:1789672706.738913:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379200 00000100:00100000:0.0:1789672706.738937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 156 00000100:00100000:0.0:1789672706.738944:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543379584:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672706.738974:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543379584:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 31us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672706.738980:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 156 00000100:00100000:0.0:1789672706.738992:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 157 00000100:00100000:0.0:1789672706.738998:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa611838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+29:2359:x1876607543379200:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672706.739028:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa611838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+29:2359:x1876607543379200:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 31us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672706.739034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 157 00000100:00080000:0.0:1789672706.739701:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672706.739709:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672706.739712:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789672707.318914:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789672707.390010:0:12615:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672707.390022:0:12615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672707.390473:0:12615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789672707.390486:0:12615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672707.584704:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672707.588264:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379840 00000100:00100000:1.0:1789672707.588289:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379840 00000100:00100000:1.0:1789672707.588383:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 235 00000100:00100000:1.0:1789672707.588396:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+29:11638:x1876607543379840:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672707.588424:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672707.588451:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d097b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb73 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.588623:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d097ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.588643:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d097ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.588658:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d097ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672707.588673:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789672707.589206:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d097b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb73 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.589231:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d097ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb73 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.589240:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672707.589243:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789672707.589248:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e800, rc 0) 00000100:00100000:1.0:1789672707.589347:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7225c799-181e-4570-897c-b66842e45960+31:11638:x1876607543379840:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 953us (4658us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789672707.589357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 235 00000100:00100000:3.0:1789672707.599631:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672707.599975:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543379968 00000100:00100000:1.0:1789672707.599991:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543379968 00000100:00100000:1.0:1789672707.600659:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 236 00000100:00100000:1.0:1789672707.600675:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+31:11638:x1876607543379968:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:1.0:1789672707.600779:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601255:0:7918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601275:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601312:0:7918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601321:0:7918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601330:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601337:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542fe00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672707.601342:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601461:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601481:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:1.0:1789672707.601485:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672707.601492:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672707.601499:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672707.603339:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+31:11638:x1876607543379968:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 2655us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672707.603369:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 236 00000100:00100000:2.0:1789672707.716984:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672707.717051:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380096 00000100:00100000:0.0:1789672707.717067:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380096 00000100:00100000:0.0:1789672707.717156:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 71 00000100:00100000:0.0:1789672707.717169:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2357:x1876607543380096:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:0.0:1789672707.717196:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672707.717223:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e7b7ff5/0x2247cb9491d097cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb7a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672707.717255:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aac3d00, atime: 0x6aac3cff, ctime: 0x6aac3d00, blocks: 0xb 00010000:00010000:0.0:1789672707.717281:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1789672707.717286:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672707.717297:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e7b7ff5/0x2247cb9491d097cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb7a expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672707.717320:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e7b7ff5/0x2247cb9491d097cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb7a expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672707.717339:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910c00, rc 0) 00000100:00100000:0.0:1789672707.717417:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+8:2357:x1876607543380096:12345-192.168.202.39@tcp:101:cat.0 Request processed in 251us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672707.717426:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 71 00000100:00100000:3.0:1789672707.720764:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672707.720974:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380224 00000100:00100000:0.0:1789672707.720989:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380224 00002000:00100000:0.0:1789672707.721061:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fa607b4df80 x1876607543380224/t0(0) o3->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:333/0 lens 488/0 e 0 to 0 dl 1789672718 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672707.721112:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa607b4df80 with x1876607543380224 ext(0->4095) 00002000:00010000:0.0:1789672707.721120:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa607b4df80 00000100:00100000:0.0:1789672707.721210:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:0.0:1789672707.721221:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7225c799-181e-4570-897c-b66842e45960+8:2359:x1876607543380224:12345-192.168.202.39@tcp:3:cat.0 00000100:00100000:0.0:1789672707.721523:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7225c799-181e-4570-897c-b66842e45960+8:2359:x1876607543380224:12345-192.168.202.39@tcp:3:cat.0 Request processed in 303us (779us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789672707.721533:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00002000:00100000:0.0:1789672707.721542:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fa607b4df80 x1876607543380224/t0(0) o3->7225c799-181e-4570-897c-b66842e45960@192.168.202.39@tcp:333/0 lens 488/4536 e 0 to 0 dl 1789672718 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672707.721551:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa607b4df80 with x1876607543380224 ext(0->4095) 00002000:00010000:0.0:1789672707.721555:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa607b4df80 00000100:00100000:0.0:1789672708.019289:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672708.023335:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564330624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672708.023461:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672708.023774:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564330624 00000100:00100000:1.0:1789672708.023821:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564330624 00000100:00100000:1.0:1789672708.023925:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789672708.023939:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564330624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672708.023988:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672708.024099:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564330624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672708.024107:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789672708.024357:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672708.025880:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789672708.025895:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789672708.025982:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa62f34aa00, transno 4294967310 00000100:00100000:2.0:1789672708.026026:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f34b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564330624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672708.348004:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789672708.659136:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672708.659150:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672708.659189:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789672708.659202:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789672709.364576:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789672709.639170:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789672709.639205:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789672709.641065:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000001:00080000:0.0:1789672709.641084:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1789672709.641124:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789672709.641181:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1789672709.641197:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1789672709.641254:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa624e8da80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789672709.641260:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa62f399e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa624e8d480 00000020:00080000:0.0:1789672709.641264:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa62f399a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa62f5eac00 00000020:00080000:2.0:1789672709.641293:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789672709.641595:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789672710.068943:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564330752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672710.069050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672710.069104:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564331136:0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.069134:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564331264:0@lo:400:kworker.0 00000100:00100000:1.0:1789672710.069153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672710.069158:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672710.069210:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564331008:0@lo:400:kworker.0 00000100:00100000:3.0:1789672710.069216:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa502bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564330880:0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.069304:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564330752 00000100:00100000:2.0:1789672710.069314:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564330752 00000100:00100000:2.0:1789672710.069399:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789672710.069411:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564330752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672710.069462:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672710.069517:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564330752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672710.069524:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789672710.069561:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331264 00000100:00100000:2.0:1789672710.069564:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331264 00000100:00100000:2.0:1789672710.069596:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789672710.069603:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564331264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.069672:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564331264:12345-0@lo:400:kworker.0 Request processed in 58us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672710.069679:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789672710.069699:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672710.069704:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672710.069765:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564331264:0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.069777:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789672710.069812:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa63a22e680, transno 4294967321 00000004:00080000:2.0:1789672710.069825:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa635640380, transno 4294967322 00000004:00080000:2.0:1789672710.069830:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789672710.069869:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564330752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672710.070409:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331136 00000100:00100000:2.0:1789672710.070415:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331136 00000100:00100000:2.0:1789672710.070458:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789672710.070465:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564331136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.070520:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564331136:12345-0@lo:400:kworker.0 Request processed in 54us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672710.070526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1789672710.070556:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672710.074566:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564331136:0@lo:400:kworker.0 00000100:00100000:3.0:1789672710.076040:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672710.076115:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564331392:0@lo:400:kworker.0 00000100:00100000:3.0:1789672710.076200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672710.076326:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564330880 00000100:00100000:1.0:1789672710.076339:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564330880 00000100:00100000:1.0:1789672710.076418:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789672710.076429:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564330880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672710.076500:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3300:x1876607564330880:12345-0@lo:400:kworker.0 Request processed in 72us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672710.076508:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789672710.077890:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c6595f6-f042-46a8-abe4-2c10b8a32248:3300:1876607564330880:0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.085645:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331392 00000100:00100000:2.0:1789672710.085667:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331392 00000100:00100000:2.0:1789672710.085895:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789672710.085909:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564331392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672710.086042:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876607564331392:12345-0@lo:400:kworker.0 Request processed in 136us (9840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672710.086050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1789672710.086148:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672710.086203:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa641b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1876607564331392:0@lo:400:kworker.0 00000100:00100000:0.0:1789672710.091474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672710.091602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331008 00000100:00100000:3.0:1789672710.091615:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331008 00000100:00100000:3.0:1789672710.091704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789672710.091715:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564331008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672710.091822:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564331008:12345-0@lo:400:kworker.0 Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672710.091830:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789672710.091934:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa502bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564331008:0@lo:400:kworker.0 00010000:00010000:3.0:1789672710.390432:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672711.411767:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672711.850377:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672711.850428:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672711.850468:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672711.850506:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672711.850543:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672711.850588:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380608 00000100:00100000:2.0:1789672711.850602:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380608 00000100:00100000:2.0:1789672711.850680:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380736 00000100:00100000:2.0:1789672711.850684:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380736 00000100:00100000:2.0:1789672711.850713:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 83 00000100:00100000:2.0:1789672711.850726:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543380608:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672711.850985:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543380608:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 248us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.851000:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 83 00000100:00100000:2.0:1789672711.851040:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:2.0:1789672711.851065:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543380736:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672711.851133:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543380736:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 74us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.851143:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:3.0:1789672711.851235:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380864 00000100:00100000:3.0:1789672711.851242:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380864 00000100:00100000:3.0:1789672711.851292:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380480 00000100:00100000:3.0:1789672711.851304:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380480 00000100:00100000:3.0:1789672711.851340:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 161 00000100:00100000:3.0:1789672711.851350:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543380864:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672711.851403:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543380864:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 55us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672711.851411:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 161 00000100:00100000:3.0:1789672711.851429:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 162 00000100:00100000:3.0:1789672711.851436:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+18:2359:x1876607543380480:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672711.851471:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+18:2359:x1876607543380480:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 35us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672711.851504:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 162 00000100:00080000:3.0:1789672711.851542:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672711.851547:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672711.851550:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672711.861046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380352 00000100:00100000:0.0:1789672711.861073:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380352 00000100:00100000:0.0:1789672711.861199:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 297 00000100:00100000:0.0:1789672711.861213:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543380352:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672711.861901:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2359:x1876607543380352:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 686us (11536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672711.861912:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 297 00010000:00010000:2.0:1789672712.436619:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672713.140981:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564331520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672713.141070:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672713.141161:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331520 00000100:00100000:2.0:1789672713.141170:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331520 00000100:00100000:2.0:1789672713.141230:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789672713.141252:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564331520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672713.141309:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672713.141362:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564331520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672713.141370:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789672713.141395:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672713.141439:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564331520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672713.370718:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672713.370835:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543380992 00000100:00100000:3.0:1789672713.370849:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543380992 00000100:00100000:3.0:1789672713.370945:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 237 00000100:00100000:3.0:1789672713.370958:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+18:11283:x1876607543380992:12345-192.168.202.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789672713.371115:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+18:11283:x1876607543380992:12345-192.168.202.39@tcp:60:lhsmtool_posix.0 Request processed in 160us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672713.371123:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 237 00000100:00080000:2.0:1789672713.371424:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672713.374175:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672713.374458:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543381248 00000100:00100000:1.0:1789672713.374473:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543381248 00000100:00100000:1.0:1789672713.374555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 65 00000100:00100000:1.0:1789672713.374576:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+18:11283:x1876607543381248:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672713.375826:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+19:11283:x1876607543381248:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 1208us (1621us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789672713.375858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 65 00010000:00010000:3.0:1789672713.459826:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672714.483175:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789672714.788414:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789672714.788445:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789672714.788936:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789672714.788952:0:5864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1789672715.188536:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564332032:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.188630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.188933:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789672715.188941:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564331648:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.188974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.188996:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564332160:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.189051:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564331776:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.189086:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564332288:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.189122:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672715.189127:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564331904:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.189181:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332160 00000100:00100000:0.0:1789672715.189212:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332160 00000100:00100000:0.0:1789672715.189281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331776 00000100:00100000:0.0:1789672715.189284:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331776 00000100:00100000:0.0:1789672715.189296:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331904 00000100:00100000:0.0:1789672715.189298:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331904 00000100:00100000:0.0:1789672715.189316:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789672715.189325:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564332160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189388:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564332160:12345-0@lo:400:kworker.0 Request processed in 63us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672715.189395:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789672715.189416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789672715.189421:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564331776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189449:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564331776:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672715.189454:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789672715.189464:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789672715.189469:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564331904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189506:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564331904:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672715.189512:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1789672715.189530:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672715.189571:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564331904:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189583:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564331776:0@lo:400:kworker.0 00000100:00100000:0.0:1789672715.189614:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564332160:0@lo:400:kworker.0 00000100:00100000:1.0:1789672715.189858:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332032 00000100:00100000:1.0:1789672715.189864:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332032 00000100:00100000:1.0:1789672715.189916:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332288 00000100:00100000:1.0:1789672715.189919:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332288 00000100:00100000:1.0:1789672715.189947:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789672715.189955:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564332032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672715.190005:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564332032:12345-0@lo:400:kworker.0 Request processed in 51us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672715.190011:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789672715.190024:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789672715.190030:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564332288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672715.190065:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564332288:12345-0@lo:400:kworker.0 Request processed in 35us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672715.190071:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789672715.190090:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564331648 00000100:00100000:1.0:1789672715.190093:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564331648 00000100:00100000:1.0:1789672715.190120:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789672715.190126:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564331648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672715.190159:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3301:x1876607564331648:12345-0@lo:400:kworker.0 Request processed in 34us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672715.190164:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789672715.190217:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564332288:0@lo:400:kworker.0 00000100:00100000:1.0:1789672715.190239:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f8b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564331648:0@lo:400:kworker.0 00000100:00100000:1.0:1789672715.190249:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564332032:0@lo:400:kworker.0 00000100:00080000:0.0:1789672715.190871:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672715.190878:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672715.195739:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564332416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672715.195868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672715.196064:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332416 00000100:00100000:0.0:1789672715.196075:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332416 00000100:00100000:0.0:1789672715.196148:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789672715.196160:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564332416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672715.196209:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672715.196267:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564332416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672715.196275:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789672715.196384:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564332416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789672715.511423:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672715.596215:0:12815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:18:34 (1789672714) 00010000:00010000:0.0:1789672716.532288:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672716.970163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672716.970970:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672716.971013:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543381504 00000100:00100000:1.0:1789672716.971026:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543381504 00000100:00100000:1.0:1789672716.971106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 166 00000100:00100000:1.0:1789672716.971118:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+18:2360:x1876607543381504:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672716.971308:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543381376 00000100:00100000:2.0:1789672716.971313:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543381376 00000100:00100000:2.0:1789672716.971349:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 299 00000100:00100000:2.0:1789672716.971357:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543381376:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672716.971441:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2360:x1876607543381376:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 84us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672716.971449:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 299 00000100:00100000:1.0:1789672716.971693:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7225c799-181e-4570-897c-b66842e45960+18:2360:x1876607543381504:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 576us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672716.971701:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 166 00000100:00080000:1.0:1789672716.971724:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672716.976109:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672716.976170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672716.976328:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672716.976368:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543381888 00000100:00100000:1.0:1789672716.976382:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543381888 00000100:00100000:1.0:1789672716.976462:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 167 00000100:00100000:1.0:1789672716.976485:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543381888:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672716.976584:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2359:x1876607543381888:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672716.976592:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 167 00000100:00080000:1.0:1789672716.976619:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672716.976685:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543381760 00000100:00100000:0.0:1789672716.976690:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543381760 00000100:00100000:0.0:1789672716.976734:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543381632 00000100:00100000:0.0:1789672716.976738:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543381632 00000100:00100000:0.0:1789672716.976765:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:0.0:1789672716.976773:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543381760:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672716.976896:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2359:x1876607543381760:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 123us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672716.976903:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:0.0:1789672716.976918:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 88 00000100:00100000:0.0:1789672716.976926:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543381632:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672716.976951:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2359:x1876607543381632:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 27us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672716.976958:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 88 00000100:00080000:1.0:1789672716.977078:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672716.977101:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789672717.569595:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672718.262128:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564332544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672718.262224:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672718.263235:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332544 00000100:00100000:2.0:1789672718.263245:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332544 00000100:00100000:2.0:1789672718.263320:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789672718.263331:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564332544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672718.263366:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789672718.263423:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564332544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672718.263430:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789672718.263633:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672718.263671:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564332544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672718.286544:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672718.286704:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543382016 00000100:00100000:1.0:1789672718.286718:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543382016 00000100:00100000:1.0:1789672718.286842:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 238 00000100:00100000:1.0:1789672718.286856:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:12303:x1876607543382016:12345-192.168.202.39@tcp:101:lsof.0 00010000:00010000:1.0:1789672718.286884:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672718.286913:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d097d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb81 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672718.286998:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672718.287016:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672718.287033:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672718.287081:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789672718.287086:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672718.287136:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672718.287167:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ec00/0x2247cb9491d097d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb81 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672718.287227:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb81 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672718.287236:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:1.0:1789672718.287239:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672718.287244:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fe00, rc 0) 00000100:00100000:1.0:1789672718.287641:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:12303:x1876607543382016:12345-192.168.202.39@tcp:101:lsof.0 Request processed in 787us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672718.287660:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 238 00000100:00080000:2.0:1789672718.287772:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672718.579169:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672718.899847:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672718.899860:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672718.902024:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789672718.902041:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789672719.603863:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672720.010388:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672720.013930:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543382272 00000100:00100000:1.0:1789672720.013954:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543382272 00000100:00100000:1.0:1789672720.014067:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:1.0:1789672720.014083:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+18:12304:x1876607543382272:12345-192.168.202.39@tcp:35:umount.0 00000100:00080000:2.0:1789672720.014209:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672720.014622:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7225c799-181e-4570-897c-b66842e45960+19:12304:x1876607543382272:12345-192.168.202.39@tcp:35:umount.0 Request processed in 542us (4249us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789672720.014631:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 66 00000100:00100000:3.0:1789672720.017343:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672720.017470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543382528 00000100:00100000:2.0:1789672720.017483:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543382528 00000100:00100000:2.0:1789672720.017572:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 67 00000100:00100000:2.0:1789672720.017586:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+19:12304:x1876607543382528:12345-192.168.202.39@tcp:35:umount.0 00000100:00100000:2.0:1789672720.019488:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+20:12304:x1876607543382528:12345-192.168.202.39@tcp:35:umount.0 Request processed in 1892us (2148us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789672720.019503:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 67 00000100:00100000:2.0:1789672720.022854:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672720.023108:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543382784 00000100:00100000:3.0:1789672720.023124:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543382784 00000100:00100000:3.0:1789672720.023208:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 68 00000100:00100000:3.0:1789672720.023222:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6031b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+20:12304:x1876607543382784:12345-192.168.202.39@tcp:35:umount.0 00000100:00100000:3.0:1789672720.023583:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6031b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+21:12304:x1876607543382784:12345-192.168.202.39@tcp:35:umount.0 Request processed in 362us (743us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789672720.023591:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 68 00000100:00100000:0.0:1789672720.028231:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672720.028333:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543383040 00000100:00100000:3.0:1789672720.028364:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543383040 00000100:00100000:3.0:1789672720.028434:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:3.0:1789672720.028459:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+21:12304:x1876607543383040:12345-192.168.202.39@tcp:35:umount.0 00000100:00100000:3.0:1789672720.029090:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7225c799-181e-4570-897c-b66842e45960+22:12304:x1876607543383040:12345-192.168.202.39@tcp:35:umount.0 Request processed in 643us (871us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789672720.029100:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 69 00000100:00100000:0.0:1789672720.048605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672720.048707:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672720.055465:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672720.059526:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543383168 00000100:00100000:3.0:1789672720.059549:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543383168 00000100:00100000:3.0:1789672720.061178:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543383296 00000100:00100000:3.0:1789672720.061193:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543383296 00000100:00100000:3.0:1789672720.061239:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:3.0:1789672720.061252:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+14:2357:x1876607543383168:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672720.061274:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672720.061300:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6421ef200/0x2247cb9491d087c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf6db expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672720.061325:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672720.061413:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+13:2357:x1876607543383168:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 163us (12823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672720.061421:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:3.0:1789672720.061453:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:3.0:1789672720.061462:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:2357:x1876607543383296:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672720.061471:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672720.061481:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d08a4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7de expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672720.061491:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672720.061530:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:2357:x1876607543383296:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 70us (12823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672720.061537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:0.0:1789672720.062552:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672720.062668:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543383424 00000100:00100000:3.0:1789672720.062678:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543383424 00000100:00100000:3.0:1789672720.062726:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:3.0:1789672720.062735:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:2358:x1876607543383424:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672720.062749:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672720.062763:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031400/0x2247cb9491d08801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf713 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672720.062779:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672720.062850:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2358:x1876607543383424:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 115us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672720.062857:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:3.0:1789672720.076844:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543383808 00000100:00100000:3.0:1789672720.076868:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543383808 00000100:00100000:3.0:1789672720.076987:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 72 00000100:00100000:3.0:1789672720.077003:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+7:2356:x1876607543383808:12345-192.168.202.39@tcp:9:umount.0 00000020:00000080:3.0:1789672720.077052:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08d9c 00000020:00010000:3.0:1789672720.077062:0:6685:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fa63adc1000: total 0 00000100:00080000:3.0:1789672720.077068:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9fa6186e0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672720.077133:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789672720.077547:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7225c799-181e-4570-897c-b66842e45960+5:2356:x1876607543383808:12345-192.168.202.39@tcp:9:umount.0 Request processed in 547us (14999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672720.077556:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 72 00000020:00010000:1.0:1789672720.078012:0:8499:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fa63adc1000: total 0 00010000:00010000:1.0:1789672720.078059:0:8499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa63adc1000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789672720.078132:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e7b7ff5/0x2247cb9491d097cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb7a expref: 4 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672720.078178:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b620ef5/0x2247cb9491d0913f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9b3 expref: 3 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672720.078196:0:8499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa63adc1000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789672720.078229:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672720.078231:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672720.078233:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672720.079394:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672720.083959:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672720.084153:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543383936 00000100:00100000:1.0:1789672720.084167:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543383936 00000100:00100000:1.0:1789672720.084260:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00100000:1.0:1789672720.084274:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+5:2356:x1876607543383936:12345-192.168.202.39@tcp:9:umount.0 00000020:00000080:1.0:1789672720.084317:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08b3b 00000100:00080000:1.0:1789672720.084331:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9fa641bb6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789672720.084391:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789672720.084413:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672720.084812:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7225c799-181e-4570-897c-b66842e45960+2:2356:x1876607543383936:12345-192.168.202.39@tcp:9:umount.0 Request processed in 540us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672720.084822:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 73 00000100:00080000:2.0:1789672720.085411:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672720.094780:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672720.095001:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543384960 00000100:00100000:1.0:1789672720.095015:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543384960 00000100:00100000:1.0:1789672720.095097:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 239 00000100:00100000:1.0:1789672720.095109:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+22:2356:x1876607543384960:12345-192.168.202.39@tcp:39:umount.0 00000020:00000080:1.0:1789672720.095156:0:7918:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d087d7 00000020:00010000:1.0:1789672720.095179:0:7918:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fa639b3e000: total 0 00000100:00080000:1.0:1789672720.095184:0:7918:0:(import.c:65:import_set_state_nolock()) ffff9fa63519f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789672720.095210:0:7918:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1789672720.095749:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7225c799-181e-4570-897c-b66842e45960+21:2356:x1876607543384960:12345-192.168.202.39@tcp:39:umount.0 Request processed in 640us (980us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789672720.095759:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 239 00000020:00010000:0.0:1789672720.096036:0:5819:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fa639b3e000: total 0 00010000:00010000:0.0:1789672720.096092:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa639b3e000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789672720.096130:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa6184b6800) 00010000:00010000:0.0:1789672720.096134:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672720.096145:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fc00/0x2247cb9491d08aa1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7ec expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096177:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672720.096180:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789672720.096184:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f600/0x2247cb9491d0912a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9ac expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096199:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672720.096201:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672720.096205:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911200/0x2247cb9491d09790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb65 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096218:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672720.096220:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789672720.096224:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67da00/0x2247cb9491d08b11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf808 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096258:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672720.096261:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672720.096265:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911800/0x2247cb9491d09193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9c8 expref: 16 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096278:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672720.096281:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789672720.096284:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e800/0x2247cb9491d097ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb73 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096295:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa611330f00) 00010000:00010000:0.0:1789672720.096297:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672720.096301:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e000/0x2247cb9491d08dfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf8da expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096316:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672720.096318:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672720.096321:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09020 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf966 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096335:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672720.096337:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672720.096340:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c000/0x2247cb9491d0948e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfaa1 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096355:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa6184b6100) 00010000:00010000:0.0:1789672720.096357:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789672720.096369:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d091af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf9cf expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096387:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672720.096390:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672720.096394:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f400/0x2247cb9491d08abd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7f3 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096408:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa610c05800) 00010000:00010000:0.0:1789672720.096410:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672720.096414:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09100 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf99e expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096431:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa602b49d00) 00010000:00010000:0.0:1789672720.096433:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672720.096437:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa60929fc00/0x2247cb9491d096b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb2d expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672720.096464:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa639b3e000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789672720.096478:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672720.096481:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672720.096483:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672720.307243:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672720.307279:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672720.307381:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672720.307665:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564333056:0@lo:400:kworker.0 00000100:00100000:2.0:1789672720.307685:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564333184:0@lo:400:kworker.0 00000100:00100000:3.0:1789672720.307720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672720.307735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672720.307774:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333056 00000100:00100000:3.0:1789672720.307810:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333056 00000100:00100000:2.0:1789672720.307823:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333184 00000100:00100000:2.0:1789672720.307830:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333184 00000100:00100000:3.0:1789672720.307889:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789672720.307891:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789672720.307904:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564333056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672720.307906:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564333184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672720.307972:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564333184:12345-0@lo:400:kworker.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672720.307980:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789672720.308034:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564333184:0@lo:400:kworker.0 00000100:00100000:3.0:1789672720.308036:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564333056:12345-0@lo:400:kworker.0 Request processed in 135us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672720.308048:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1789672720.308071:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672720.308077:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672720.308091:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564333056:0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308260:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564332800:0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672720.308337:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564333312:0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672720.308388:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672720.308393:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564332928:0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308433:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672720.308487:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333312 00000100:00100000:1.0:1789672720.308492:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333312 00000100:00100000:1.0:1789672720.308522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332928 00000100:00100000:1.0:1789672720.308525:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332928 00000100:00100000:1.0:1789672720.308541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789672720.308547:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564333312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308597:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564333312:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672720.308603:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789672720.308618:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789672720.308624:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564332928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308653:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564332928:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672720.308659:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789672720.308690:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564332928:0@lo:400:kworker.0 00000100:00100000:1.0:1789672720.308700:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564333312:0@lo:400:kworker.0 00000100:00100000:0.0:1789672720.308903:0:11684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332672 00000100:00100000:0.0:1789672720.308909:0:11684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332672 00000100:00100000:0.0:1789672720.308953:0:11684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789672720.308962:0:11684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564332672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672720.308997:0:11684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672720.309040:0:11684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa502bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564332672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672720.309057:0:11684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789672720.309126:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564332800 00000100:00100000:2.0:1789672720.309131:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564332800 00000100:00100000:2.0:1789672720.309166:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789672720.309173:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564332800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672720.309213:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3299:x1876607564332800:12345-0@lo:400:kworker.0 Request processed in 41us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672720.309219:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789672720.309253:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564332800:0@lo:400:kworker.0 00000100:00100000:2.0:1789672720.309283:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564332672:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672720.309535:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672720.309540:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789672720.627170:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672721.651817:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672721.919096:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000020:00000080:2.0:1789672721.919110:0:6710:0:(genops.c:885:class_export_put()) final put ffff9fa641bb5800/7225c799-181e-4570-897c-b66842e45960 00000020:00000080:0.0:1789672721.919193:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa641bb5800/7225c799-181e-4570-897c-b66842e45960 for lustre-OST0000 00000020:00000080:0.0:1789672721.919261:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa641bb6800 for lustre-OST0000 00000100:00100000:0.0:1789672722.090137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672722.090258:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672722.090361:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543385088 00000100:00100000:2.0:1789672722.090375:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543385088 00000100:00100000:2.0:1789672722.090472:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 301 00000100:00100000:2.0:1789672722.090485:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543385088:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672722.090589:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2360:x1876607543385088:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672722.090597:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 301 00000100:00100000:1.0:1789672722.093938:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543385216 00000100:00100000:1.0:1789672722.093961:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543385216 00000100:00100000:1.0:1789672722.094153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 171 00000100:00100000:1.0:1789672722.094166:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:2360:x1876607543385216:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672722.094287:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:2360:x1876607543385216:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 124us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672722.094295:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 171 00000100:00080000:3.0:1789672722.101487:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672722.386343:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672722.386414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672722.387650:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672722.391838:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672722.391902:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543385856 00000100:00100000:0.0:1789672722.391915:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543385856 00000100:00100000:0.0:1789672722.391987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 240 00000100:00100000:0.0:1789672722.391999:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+6:2356:x1876607543385856:12345-192.168.202.39@tcp:39:umount.0 00000020:00000080:0.0:1789672722.392052:0:5830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d088be 00000020:00010000:0.0:1789672722.392064:0:5830:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fa5022ae800: total 0 00000100:00080000:0.0:1789672722.392071:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9fa5022af800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672722.392100:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789672722.393963:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1+5:2356:x1876607543385856:12345-192.168.202.39@tcp:39:umount.0 Request processed in 1951us (2125us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789672722.393982:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 240 00000020:00010000:0.0:1789672722.394044:0:5819:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fa5022ae800: total 0 00010000:00010000:0.0:1789672722.394049:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672722.394106:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa5022ae800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789672722.394159:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05500) 00010000:00010000:0.0:1789672722.394163:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672722.394174:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fe00/0x2247cb9491d097dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb81 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672722.394223:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa5022ae800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789672722.394235:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672722.394237:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672722.394238:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672722.396221:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543385472 00000100:00100000:2.0:1789672722.396244:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543385472 00000100:00100000:2.0:1789672722.396361:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543385728 00000100:00100000:2.0:1789672722.396365:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543385728 00000100:00100000:0.0:1789672722.396641:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543385600 00000100:00100000:0.0:1789672722.396646:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543385600 00000100:00100000:0.0:1789672722.396681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:0.0:1789672722.396693:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+12:2357:x1876607543385472:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672722.396712:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672722.396748:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f2200/0x2247cb9491d088a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf728 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672722.396772:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672722.396869:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+11:2357:x1876607543385472:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 179us (10542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672722.396876:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:0.0:1789672722.396896:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:0.0:1789672722.396903:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+10:2357:x1876607543385600:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672722.396910:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672722.396919:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa642045400/0x2247cb9491d088b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf752 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672722.396930:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672722.396949:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f8f297e-d024-4f2e-b44a-c373b0e97659+9:2357:x1876607543385600:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 46us (9307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672722.396977:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:2.0:1789672722.397653:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:2.0:1789672722.397664:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f8f297e-d024-4f2e-b44a-c373b0e97659+8:2357:x1876607543385728:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672722.397674:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672722.397695:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67d400/0x2247cb9491d08a46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf7d7 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672722.397708:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672722.397880:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f8f297e-d024-4f2e-b44a-c373b0e97659+7:2357:x1876607543385728:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 219us (11465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672722.397889:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:0.0:1789672722.429968:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672722.435222:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386112 00000100:00100000:2.0:1789672722.435247:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386112 00000100:00100000:2.0:1789672722.435348:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 302 00000100:00100000:2.0:1789672722.435362:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+7:2356:x1876607543386112:12345-192.168.202.39@tcp:251:umount.0 00000020:00000080:2.0:1789672722.435472:0:5824:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d087b4 00000020:00010000:2.0:1789672722.435482:0:5824:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fa62f3b2800: total 0 00000100:00080000:2.0:1789672722.435489:0:5824:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3b0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789672722.435607:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f8f297e-d024-4f2e-b44a-c373b0e97659+3:2356:x1876607543386112:12345-192.168.202.39@tcp:251:umount.0 Request processed in 239us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672722.435618:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 302 00000020:00010000:3.0:1789672722.437130:0:8499:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fa62f3b2800: total 0 00010000:00010000:3.0:1789672722.437206:0:8499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa62f3b2800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789672722.437252:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f2400/0x2247cb9491d08808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bf71a expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672722.437274:0:8499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa62f3b2800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789672722.437284:0:8499:0:(genops.c:885:class_export_put()) final put ffff9fa62f3b2800/7f8f297e-d024-4f2e-b44a-c373b0e97659 00010000:00010000:3.0:1789672722.437302:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672722.437304:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672722.437306:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789672722.437926:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa62f3b2800/7f8f297e-d024-4f2e-b44a-c373b0e97659 for MGS 00000020:00000080:0.0:1789672722.437978:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa62f3b0000 for MGS 00010000:00010000:0.0:1789672722.675632:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672723.379713:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564333440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672723.379827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672723.380099:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333440 00000100:00100000:0.0:1789672723.380120:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333440 00000100:00100000:0.0:1789672723.380195:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672723.380205:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564333440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672723.380260:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672723.380317:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564333440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672723.380324:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789672723.381305:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672723.381768:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564333440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672723.698927:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.723146:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789672724.753674:0:13014:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789672724.764055:0:13014:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789672724.764115:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.764133:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.764142:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.764169:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.764195:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789672724.764201:0:13014:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789672724.764225:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672724.764231:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789672724.764237:0:13014:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789672724.764267:0:13014:0:(import.c:65:import_set_state_nolock()) ffff9fa641b8a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789672724.764327:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672724.764335:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.764344:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c800 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672724.764348:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.764359:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672724.764367:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672724.764393:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789672724.764396:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789672724.764408:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789672724.764436:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.764443:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672724.764472:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.764483:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d08847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d0884e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.764496:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672724.764498:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672724.764500:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672724.764580:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672724.764605:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564333696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672724.764696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672724.764914:0:11163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333696 00000100:00100000:0.0:1789672724.764924:0:11163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333696 00000100:00100000:0.0:1789672724.765017:0:11163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672724.765028:0:11163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564333696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672724.765043:0:11163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672724.765061:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030200/0x2247cb9491d0884e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08847 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672724.765073:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564333568:0@lo:39:umount.0 00010000:00010000:0.0:1789672724.765074:0:11163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672724.765116:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672724.765116:0:11163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3302:x1876607564333696:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.765124:0:11163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672724.765170:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333568 00000100:00100000:3.0:1789672724.765174:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333568 00000100:00100000:3.0:1789672724.765211:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789672724.765218:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876607564333568:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789672724.765247:0:5831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d085d1 00000100:00080000:3.0:1789672724.765258:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9fa6117c1800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789672724.765292:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564333696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672724.765341:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672724.766395:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3298:x1876607564333568:12345-0@lo:39:umount.0 Request processed in 1174us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672724.766414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789672724.766423:0:5831:0:(genops.c:885:class_export_put()) final put ffff9fa6053c2000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789672724.766437:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa641b8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789672724.766456:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564333568:0@lo:39:umount.0 00000100:00080000:1.0:1789672724.766556:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789672724.766560:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789672724.766565:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789672724.767447:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa6053c2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789672724.767530:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa6117c1800 for lustre-MDT0000 00010000:00010000:1.0:1789672724.767641:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767656:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767663:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767671:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767741:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672724.767749:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767756:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767771:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767778:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672724.767818:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672724.767826:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672724.767834:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030c00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672724.767839:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672724.767848:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672724.767856:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672724.767862:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672724.767862:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789672724.767865:0:8499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789672724.767869:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767875:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767882:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767888:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767935:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789672724.767943:0:13014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767950:0:13014:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767957:0:13014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672724.767974:0:13014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768002:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789672724.768007:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768014:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929e400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672724.768018:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.768019:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672724.768025:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672724.768032:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672724.768037:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672724.768046:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789672724.768049:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789672724.768081:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768087:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672724.768109:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768116:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d0876e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08775 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768132:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672724.768136:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672724.768137:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564333824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672724.768142:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421efe00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672724.768144:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768150:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672724.768156:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672724.768161:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672724.768163:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1789672724.768172:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768177:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672724.768199:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672724.768203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672724.768207:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.768209:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.768210:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.768226:0:8499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768232:0:8499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672724.768237:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768243:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030c00/0x2247cb9491d08855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d0885c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672724.768253:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.768255:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.768256:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672724.768258:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564333952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672724.768282:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672724.768302:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672724.768307:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564334080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672724.768313:0:13014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789672724.768318:0:13014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421efe00/0x2247cb9491d08522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08529 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672724.768326:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789672724.768331:0:13014:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1789672724.768334:0:13014:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789672724.768337:0:13014:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1789672724.768361:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333824 00000020:01000004:1.0:1789672724.768368:0:13014:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000100:00100000:0.0:1789672724.768368:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333824 00000020:01000000:1.0:1789672724.768372:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789672724.768376:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672724.768393:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1789672724.768406:0:13014:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9fa62f3d7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789672724.768412:0:13014:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9fa63fb91000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1789672724.768418:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564333952 00000020:00080000:1.0:1789672724.768420:0:13014:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9fa5022ae800 c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 192.168.202.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1789672724.768421:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564333952 00000020:00080000:1.0:1789672724.768425:0:13014:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9fa639b3e000 7225c799-181e-4570-897c-b66842e45960 192.168.202.39@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1789672724.768432:0:13014:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9fa604b28000) has exports, disconnecting them 00000100:00100000:0.0:1789672724.768433:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334080 00000100:00100000:0.0:1789672724.768435:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334080 00000020:00080000:1.0:1789672724.768437:0:13014:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fa62f3d7800), last request at 1789672720 00000020:00000080:1.0:1789672724.768444:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08736 00000100:00100000:0.0:1789672724.768449:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672724.768458:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+20:3302:x1876607564333824:12345-0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789672724.768463:0:13014:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d1000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789672724.768471:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672724.768537:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672724.768547:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3e00/0x2247cb9491d08775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d0876e expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.768564:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672724.768621:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+19:3302:x1876607564333824:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.768629:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:1.0:1789672724.768631:0:13014:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa62f3d7800): rc 0 00000020:00000080:1.0:1789672724.768633:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa62f3d7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789672724.768643:0:13014:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fa63fb91000), last request at 1789672720 00000100:00100000:0.0:1789672724.768646:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1789672724.768647:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d0866b 00000100:00080000:1.0:1789672724.768658:0:13014:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb93800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789672724.768659:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+18:3299:x1876607564333952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672724.768667:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672724.768678:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789672724.768685:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa62f3d7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1789672724.768714:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564333824:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789672724.768725:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa62f3d1000 for lustre-MDT0000 00000020:00080000:1.0:1789672724.768803:0:13014:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa63fb91000): rc 0 00000020:00000080:1.0:1789672724.768806:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63fb91000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789672724.768826:0:13014:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb88782d0fae0 00000100:00080000:1.0:1789672724.768850:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789672724.768855:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789672724.768870:0:13014:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789672724.768929:0:13014:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789672724.768944:0:13014:0:(import.c:65:import_set_state_nolock()) ffff9fa63f8ca800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789672724.768958:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789672724.768961:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789672724.768969:0:13014:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789672724.769028:0:13014:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789672724.769038:0:13014:0:(import.c:65:import_set_state_nolock()) ffff9fa639b28800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789672724.769070:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9fa604b28000) has no exports 00010000:00010000:0.0:1789672724.769099:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3a00/0x2247cb9491d08529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08522 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.769111:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672724.769142:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+17:3299:x1876607564333952:12345-0@lo:103:ldlm_bl.0 Request processed in 483us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.769149:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672724.769163:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672724.769169:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+16:3299:x1876607564334080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672724.769177:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672724.769185:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67d000/0x2247cb9491d0885c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08855 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.769194:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672724.769213:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:3299:x1876607564334080:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.769218:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672724.769251:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564334080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672724.769258:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564333952:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789672724.769274:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63fb91000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789672724.769303:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa63fb93800 for lustre-MDT0000 00000100:00100000:0.0:1789672724.770799:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564334208:0@lo:9:umount.0 00000100:00100000:0.0:1789672724.770875:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672724.770928:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564334336:0@lo:9:umount.0 00000100:00100000:0.0:1789672724.770982:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672724.771025:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334208 00000100:00100000:0.0:1789672724.771032:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334208 00000100:00100000:0.0:1789672724.771073:0:8063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334336 00000100:00100000:0.0:1789672724.771075:0:8063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334336 00000100:00100000:0.0:1789672724.771104:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789672724.771111:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876607564334208:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789672724.771140:0:8063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d086c6 00000100:00080000:0.0:1789672724.771149:0:8063:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb92800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672724.771188:0:8063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789672724.771594:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3298:x1876607564334208:12345-0@lo:9:umount.0 Request processed in 481us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.771603:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789672724.771621:0:8063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789672724.771629:0:8063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876607564334336:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789672724.771642:0:8063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d0879f 00000100:00080000:0.0:1789672724.771649:0:8063:0:(import.c:65:import_set_state_nolock()) ffff9fa639b29000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672724.771667:0:8063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789672724.771768:0:8063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3298:x1876607564334336:12345-0@lo:9:umount.0 Request processed in 139us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.771776:0:8063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789672724.771823:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789672724.771839:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789672724.771872:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa63f8ca800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789672724.771887:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789672724.771890:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672724.771894:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564334208:0@lo:9:umount.0 00000100:00080000:0.0:1789672724.771905:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa639b28800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789672724.771922:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789672724.771924:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672724.771927:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564334336:0@lo:9:umount.0 00010000:00010000:2.0:1789672724.777098:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.777248:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.777889:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.777893:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672724.777895:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672724.778633:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.778652:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672724.778657:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.778669:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672724.778677:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672724.778683:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789672724.778685:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789672724.778689:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789672724.778740:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.778745:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672724.778800:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.778808:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa61d910200/0x2247cb9491d08a70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08a77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.778824:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672724.778825:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672724.778844:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672724.778849:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564334464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672724.778933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672724.778968:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334464 00000100:00100000:0.0:1789672724.778976:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334464 00000100:00100000:0.0:1789672724.779036:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672724.779047:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa624e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+15:3301:x1876607564334464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672724.779064:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672724.779084:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542e600/0x2247cb9491d08a77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08a70 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672724.779100:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672724.779143:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa624e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:3301:x1876607564334464:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672724.779150:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789672724.779200:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c6595f6-f042-46a8-abe4-2c10b8a32248:3301:1876607564334464:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789672724.795583:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9fa604b28000) has no exports 00000020:00000080:0.0:1789672724.843968:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d0857d 00000020:00000080:0.0:1789672724.843985:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa639da3800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789672724.844004:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789672724.844048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639da3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789672724.844117:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672724.844130:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789672724.844136:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9fa63a3a8000) has no exports 00000020:00000080:1.0:1789672724.844579:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08576 00000020:00000080:1.0:1789672724.844586:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63ac62800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789672724.844648:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63ac62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789672724.844742:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672724.844751:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789672724.844755:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63ac67800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789672724.844758:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63ac67800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789672724.844767:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1789672724.963293:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789672724.963305:0:7637:0:(genops.c:885:class_export_put()) final put ffff9fa639b2f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789672724.963337:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000020:00000080:3.0:1789672724.963340:0:7637:0:(genops.c:885:class_export_put()) final put ffff9fa63adc1000/7225c799-181e-4570-897c-b66842e45960 00000020:00000080:1.0:1789672724.963771:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639b2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789672724.963853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63adc1000/7225c799-181e-4570-897c-b66842e45960 for lustre-OST0001 00000020:00000080:1.0:1789672724.963881:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa639b29000 for lustre-OST0001 00000020:00000080:1.0:1789672724.963890:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa6186e0800 for lustre-OST0001 00000001:00100000:2.0:1789672724.969214:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000001:00080000:2.0:1789672724.969238:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789672724.969246:0:5853:0:(genops.c:885:class_export_put()) final put ffff9fa5022ae800/c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 00000001:00100000:2.0:1789672724.969268:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7225c799-181e-4570-897c-b66842e45960 00000001:00080000:2.0:1789672724.969276:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789672724.969294:0:5853:0:(genops.c:885:class_export_put()) final put ffff9fa639b3e000/7225c799-181e-4570-897c-b66842e45960 00000020:00000080:1.0:1789672724.969346:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa5022ae800/c2e5fa1c-629f-44a3-a7bc-8ed65fc75bf1 for lustre-MDT0000 00000020:00000080:1.0:1789672724.969506:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639b3e000/7225c799-181e-4570-897c-b66842e45960 for lustre-MDT0000 00000020:00000080:1.0:1789672724.969556:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa5022af800 for lustre-MDT0000 00000020:00000080:1.0:1789672724.969562:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa63519f800 for lustre-MDT0000 00000100:00100000:2.0:1789672725.427216:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564334720:0@lo:400:kworker.0 00000100:00100000:2.0:1789672725.427331:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672725.427427:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672725.427435:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564334848:0@lo:400:kworker.0 00000100:00100000:2.0:1789672725.427459:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672725.427706:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564334592:0@lo:400:kworker.0 00000100:00100000:3.0:1789672725.427750:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672725.427931:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334592 00000100:00100000:2.0:1789672725.427942:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334592 00000100:00100000:2.0:1789672725.428010:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789672725.428020:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:3302:x1876607564334592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672725.428075:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa610336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c6595f6-f042-46a8-abe4-2c10b8a32248+14:3302:x1876607564334592:12345-0@lo:400:kworker.0 Request processed in 56us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672725.428083:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789672725.429717:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334720 00000100:00100000:0.0:1789672725.429736:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334720 00000100:00100000:0.0:1789672725.429828:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334848 00000100:00100000:0.0:1789672725.429832:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334848 00000100:00100000:0.0:1789672725.429854:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789672725.429863:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876607564334720:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789672725.429873:0:5830:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789672725.429957:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa609f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876607564334720:12345-0@lo:400:kworker.0 Request processed in 94us (2626us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789672725.429964:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789672725.429979:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789672725.429983:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876607564334848:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789672725.430008:0:5830:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789672725.430031:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1876607564334848:12345-0@lo:400:kworker.0 Request processed in 46us (2571us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789672725.430037:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1789672725.430094:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789672725.430100:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789672725.430105:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789672725.431148:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564334592:0@lo:400:kworker.0 00000100:00080000:0.0:1789672725.447214:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789672725.447234:0:3299:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 206 00000100:00080000:0.0:1789672725.447255:0:3299:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa62f3d6800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:0.0:1789672725.447311:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa6352cc380 x1876607564334976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789672725.447358:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564334848:0@lo:400:kworker.0 00000100:00080000:0.0:1789672725.447416:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789672725.447421:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb96000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789672725.447425:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789672725.447429:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb96000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789672725.447433:0:3299:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 189 00000100:00080000:0.0:1789672725.447439:0:3299:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa63fb96000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:0.0:1789672725.447453:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa6352ce680 x1876607564335104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789672725.447464:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa624e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564334720:0@lo:400:kworker.0 00000100:00100000:2.0:1789672725.447614:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564334976:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789672725.447717:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672725.447757:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1876607564335104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789672725.447822:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672725.447938:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564334976 00000100:00100000:3.0:1789672725.447948:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564334976 00000100:00100000:3.0:1789672725.447998:0:7918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564335104 00000100:00100000:3.0:1789672725.448001:0:7918:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564335104 00000100:00100000:3.0:1789672725.448020:0:7918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789672725.448028:0:7918:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3298:x1876607564334976:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789672725.448049:0:7918:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789672725.448310:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789672725.448332:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564335104:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789672725.448341:0:5830:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789672725.448390:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564335104:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (568us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789672725.448411:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789672725.448564:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb96000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672725.448570:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789672725.448574:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1876607564335104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789672725.454546:0:7918:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3298:x1876607564334976:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 6495us (6815us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789672725.454565:0:7918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789672725.454646:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672725.454654:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789672725.454659:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564334976:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789672725.747167:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672726.776270:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789672726.899009:0:13014:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa63f705420 - data ffff9fa629f29000/ffff9fa639ba2800 00000020:01000000:1.0:1789672726.899190:0:13014:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa607f14ea0 - data ffff9fa629c665e8/ffff9fa639ef6400 00000001:00000004:1.0:1789672726.905302:0:13014:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1789672726.965392:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789672726.965405:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789672726.965428:0:13014:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672726.965431:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789672726.966243:0:6834:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789672726.966251:0:6834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789672726.966264:0:6834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789672726.967281:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789672726.967287:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789672726.967304:0:13014:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672726.967307:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789672726.972685:0:8059:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789672726.972697:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789672726.972717:0:8059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:1.0:1789672727.021642:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789672727.021655:0:6710:0:(genops.c:885:class_export_put()) final put ffff9fa63fb95800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789672727.021681:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63fb95800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789672727.021754:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa63fb92800 for lustre-OST0000 00000020:00000080:3.0:1789672727.086625:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08545 00000020:00000080:3.0:1789672727.086645:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63a39e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789672727.092002:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63a39e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789672727.092302:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d0855a 00000020:00000080:3.0:1789672727.092315:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63a39a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789672727.092333:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789672727.092344:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672727.092356:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789672727.092360:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9fa604b2b380) has no exports 00000020:00000080:2.0:1789672727.092689:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63a39a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1789672727.093026:0:13014:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789672727.093041:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08798 00000020:00000080:3.0:1789672727.093048:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa62f3d2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789672727.093110:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789672727.093116:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672727.093124:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789672727.093127:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9fa62f1e4d40) has no exports 00000020:00000080:3.0:1789672727.093137:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08791 00000020:00000080:3.0:1789672727.093150:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa639b29800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789672727.093514:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa62f3d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1789672727.094345:0:13014:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789672727.094352:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789672727.094357:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789672727.094364:0:13014:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672727.094367:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789672727.094508:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639b29800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789672727.094631:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672727.094644:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789672727.094655:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d086b1 00000020:00000080:3.0:1789672727.094664:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63fb85000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789672727.094770:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa639b28800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789672727.094779:0:469:0:(genops.c:885:class_export_put()) final put ffff9fa641b8f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789672727.094782:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa641b8f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789672727.094854:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789672727.095044:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789672727.095051:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672727.095059:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789672727.095064:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9fa63a3a99c0) has no exports 00000020:00000080:3.0:1789672727.095073:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d086aa 00000020:00000080:3.0:1789672727.095079:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63f8cd800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789672727.095102:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63fb85000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1789672727.095957:0:13014:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789672727.095965:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789672727.095981:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789672727.095988:0:13014:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672727.095990:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789672727.096439:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63f8cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789672727.096554:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672727.096564:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789672727.096717:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672727.096722:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789672727.096728:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa6053c5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789672727.096731:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa6053c5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789672727.096755:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa63f8ca800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789672727.096763:0:469:0:(genops.c:885:class_export_put()) final put ffff9fa639b3c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789672727.096766:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639b3c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789672727.096772:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789672727.096839:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789672727.097533:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08561 00000020:00000080:3.0:1789672727.097544:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63a398000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789672727.097600:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789672727.097607:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672727.097615:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789672727.097621:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9fa63a3ab380) has no exports 00000020:00000080:3.0:1789672727.097651:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672727.097655:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789672727.097661:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08568 00000020:00000080:3.0:1789672727.097665:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63a39c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789672727.097870:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63a398000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789672727.097876:0:469:0:(genops.c:885:class_export_put()) final put ffff9fa63a39f800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789672727.097878:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63a39f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789672727.097888:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1789672727.098259:0:13014:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa604b25800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789672727.098264:0:13014:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa604b25800 3 00000020:01000004:3.0:1789672727.098268:0:13014:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa604b25800 from lustre-MDT0000 00000020:00000080:3.0:1789672727.098307:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672727.098314:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789672727.098319:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa63a39d800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789672727.098322:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63a39d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789672727.098333:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789672727.098373:0:13014:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789672727.098386:0:13014:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789672727.098391:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789672727.098395:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672727.098411:0:13014:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789672727.098419:0:13014:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9fa61db4b800 3c6595f6-f042-46a8-abe4-2c10b8a32248 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789672727.098427:0:13014:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9fa604b299c0) has exports, disconnecting them 00000020:00080000:3.0:1789672727.098434:0:13014:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fa61db4b800), last request at 1789672503 00000020:00000080:3.0:1789672727.098454:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d084ff 00000020:00010000:3.0:1789672727.098463:0:13014:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9fa61db4b800: total 1 00000100:00080000:3.0:1789672727.098470:0:13014:0:(import.c:65:import_set_state_nolock()) ffff9fa60bdda000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789672727.098570:0:13014:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa61db4b800): rc 0 00000020:00080000:3.0:1789672727.098576:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9fa604b299c0) has no exports 00000100:00100000:3.0:1789672727.098738:0:5825:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fa611891400:5825] 2 exiting: rc = 0 00000100:00100000:3.0:1789672727.098866:0:5824:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fa61a795600:5824] 1 exiting: rc = 0 00000020:00010000:0.0:1789672727.098967:0:13015:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9fa61db4b800: total 1 00010000:00010000:0.0:1789672727.099009:0:13015:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa61db4b800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789672727.099051:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f2a00/0x2247cb9491d08832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d0882b expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789672727.099110:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63a39c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789672727.099200:0:5823:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fa611890800:5823] 0 exiting: rc = 1 00010000:00010000:0.0:1789672727.099200:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa6208f3200/0x2247cb9491d08840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08839 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672727.099287:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099304:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099315:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099330:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099344:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099358:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099368:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099388:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099404:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099415:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099428:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099441:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099453:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099467:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099480:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099489:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099507:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099525:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099536:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099542:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099554:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789672727.099680:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929e000/0x2247cb9491d08a5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08a54 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.099702:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d0886a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08863 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.099723:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d08a69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08a62 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.099748:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031000/0x2247cb9491d0861e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d08617 expref: 4 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.099780:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600030800/0x2247cb9491d08816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d0880f expref: 3 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672727.099887:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099903:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099910:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099923:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099935:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099948:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099959:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099972:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099986:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.099993:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100004:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100016:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100031:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100047:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100066:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100083:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100090:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100098:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100104:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100111:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100117:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100122:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100130:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789672727.100251:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa600031a00/0x2247cb9491d08824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2247cb9491d0881d expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.100270:0:13015:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa61db4b800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789672727.100387:0:13015:0:(genops.c:885:class_export_put()) final put ffff9fa61db4b800/3c6595f6-f042-46a8-abe4-2c10b8a32248 00010000:00010000:0.0:1789672727.100407:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672727.100409:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672727.100412:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789672727.100447:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa61db4b800/3c6595f6-f042-46a8-abe4-2c10b8a32248 for MGS 00000020:00000080:2.0:1789672727.100500:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa60bdda000 for MGS 00000100:00100000:3.0:1789672727.100567:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100586:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100667:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100674:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100681:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100687:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100694:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100709:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100720:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100731:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100744:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100759:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100771:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100988:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.100995:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.101002:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.101009:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.101015:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.101020:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.101026:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789672727.102995:0:13014:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789672727.103005:0:13014:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789672727.104135:0:13014:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa61a6cc6c0 - data ffff9fa629ff41b0/ffff9fa62f572400 00000020:01000000:0.0:1789672727.104347:0:13014:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa604ad5d80 - data ffff9fa630ef7510/ffff9fa6103e0000 00000020:00000080:0.0:1789672727.105117:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d084ea 00000020:00000080:0.0:1789672727.105129:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa61db4f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789672727.105217:0:13014:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa604b25800 from MGS, refs=2 00000020:01000004:0.0:1789672727.105222:0:13014:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa604b25800 2 00000020:01000004:0.0:1789672727.105225:0:13014:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa604b25800 from MGS 00000020:00000080:0.0:1789672727.105252:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672727.105260:0:13014:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789672727.105264:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa61db48800/MGS 00000020:00000080:0.0:1789672727.105267:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa61db48800/MGS for MGS 00000020:01000000:0.0:1789672727.105275:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789672727.105346:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789672727.105351:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672727.105357:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789672727.105365:0:13014:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fa641b88000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789672727.105371:0:13014:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9fa6103dcd40) has exports, disconnecting them 00000020:00080000:0.0:1789672727.105403:0:13014:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fa641b88000), last request at 1789672504 00000020:00000080:0.0:1789672727.105408:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d085b5 00000020:00080000:0.0:1789672727.105420:0:13014:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa641b88000): rc 0 00000020:00000080:0.0:1789672727.105428:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa641b88000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789672727.106253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa61db4f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789672727.106275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa641b88000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789672727.109890:0:13014:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789672727.109902:0:13014:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672727.109908:0:13014:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789672727.109918:0:13014:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789672727.110003:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa641b8a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789672727.110820:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672727.110833:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789672727.110840:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa641b8a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789672727.110845:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa641b8a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789672727.110853:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789672727.110940:0:13014:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa604b25800 1 00000020:00000080:2.0:1789672727.110948:0:13014:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d084dc 00000020:00000080:2.0:1789672727.110957:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa61db4f800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789672727.110970:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789672727.110975:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672727.110981:0:13014:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789672727.110985:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9fa604b2cd40) has no exports 00000020:00000080:3.0:1789672727.111079:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa61db4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789672727.251966:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672727.251989:0:13014:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789672727.251996:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa602f4b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789672727.252139:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa602f4b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789672727.252156:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789672727.252321:0:13014:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa602f4d800 00000020:01000000:2.0:1789672727.252349:0:13014:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789672727.252355:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672727.252360:0:13014:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789672727.252366:0:13014:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9fa6103d8000) has no exports 00000100:00100000:3.0:1789672727.254176:0:5830:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9fa60bf75000:5830] 0 exiting: rc = 1 00000100:00100000:3.0:1789672727.254367:0:7918:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9fa6330ef200:7918] 3 exiting: rc = 0 00000100:00100000:3.0:1789672727.257705:0:5831:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9fa60837fa00:5831] 1 exiting: rc = 0 00000100:00100000:2.0:1789672727.258697:0:5832:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9fa60837fc00:5832] 2 exiting: rc = 0 00000100:00100000:3.0:1789672727.258912:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.258934:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.258943:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.258950:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259086:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259097:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259104:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259110:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259115:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259121:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259127:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259133:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259139:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259145:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259152:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259159:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259165:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259171:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259177:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259203:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259210:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259216:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259223:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259229:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259235:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259241:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259248:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259255:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259262:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259268:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259274:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259279:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259286:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259291:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259297:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259302:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259308:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259314:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259321:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259327:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259335:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259342:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259349:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259357:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259363:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259369:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259388:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259396:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259402:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259407:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259413:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259418:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259541:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259549:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259639:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259654:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259665:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259672:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259687:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259727:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259852:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259865:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259878:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.259892:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.280679:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fa60837ec00:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1789672727.280697:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fa60837e000:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1789672727.281146:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281158:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281166:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281174:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281180:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281188:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281195:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281202:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281209:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281215:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281223:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281230:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281238:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281245:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281251:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281256:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281261:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281267:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281272:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281279:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281284:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281290:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281295:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281304:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281311:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281319:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281326:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281331:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281337:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281343:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281364:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281369:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281388:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281394:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281400:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281406:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281412:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281417:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281435:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281441:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281446:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281451:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281457:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281463:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281468:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281475:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281480:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281486:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281492:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281497:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281503:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281509:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281515:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281522:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281528:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281534:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281541:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281548:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281677:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281687:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281693:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281699:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281706:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.281712:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.282506:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9fa60837ee00:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789672727.283307:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9fa60837e800:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1789672727.283498:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283508:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283516:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283522:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283539:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283547:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283663:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283673:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283681:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283688:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283694:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283701:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283709:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283716:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283723:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283730:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283753:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283761:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283769:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283775:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283782:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283824:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283835:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283844:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283856:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283863:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283871:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283878:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283901:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283909:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283916:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283922:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283928:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283935:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283941:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283973:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283981:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283987:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.283994:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284008:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284031:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284039:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284047:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284053:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284059:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284067:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284076:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284083:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284088:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284094:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284101:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284108:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284130:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284138:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284145:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284152:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284159:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284166:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284173:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284180:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284188:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284195:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284202:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.284209:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672727.297319:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fa61032fe00:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1789672727.297646:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fa61032f400:5837] 0 exiting: rc = 1 00000100:00100000:1.0:1789672727.297737:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297748:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297753:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297759:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297766:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297772:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297778:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297783:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297822:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297827:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297832:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297837:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297847:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297856:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297862:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297868:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297873:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297878:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297887:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297895:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297921:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297926:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297941:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297950:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297955:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297960:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297965:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297969:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297974:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.297979:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298046:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298053:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298058:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298063:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298069:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298074:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298080:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298096:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298113:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298120:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298125:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298130:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298135:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298140:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298145:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298150:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298154:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298159:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298164:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298169:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298174:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298179:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298185:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298189:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298194:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298206:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298210:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298215:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298220:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298225:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298230:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298235:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298240:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.298245:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.298885:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fa61032f200:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1789672727.299237:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fa61032ee00:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1789672727.301139:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301148:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301153:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301158:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301163:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301167:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301172:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301178:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301183:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301189:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301194:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301199:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301203:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301208:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301214:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301219:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301223:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301227:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301232:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301237:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301242:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301247:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301253:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301258:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301263:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301268:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301284:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301290:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301295:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301301:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301306:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301310:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301316:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301321:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301325:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301330:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301335:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301340:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301345:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301350:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301367:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301372:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301386:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301390:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301395:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301400:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301405:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301409:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301413:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301418:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301423:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301428:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301432:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301437:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301442:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301447:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301451:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301456:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301461:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301465:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301470:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301482:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301487:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.301492:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672727.302104:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fa6080bec00:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1789672727.302183:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fa6080a0600:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1789672727.302638:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302646:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302651:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302657:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302664:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302672:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302679:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302693:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302699:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302772:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.302781:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303174:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303180:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303186:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303192:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303197:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303202:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303208:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303214:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303218:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303223:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303229:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303234:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303239:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303245:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303250:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303255:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303260:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303265:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303271:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303276:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303281:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303297:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303302:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303308:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303313:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303318:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303323:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303328:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303333:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303337:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303342:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303347:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303451:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303459:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303464:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303469:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303474:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303479:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303483:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303489:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303493:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303498:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303502:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303507:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303512:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303516:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303520:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303524:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303529:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303533:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303537:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303542:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672727.303547:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.305309:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9fa6080a5c00:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1789672727.306870:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9fa6080bf200:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1789672727.307076:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9fa6080be000:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1789672727.307295:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307308:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307317:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307324:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307332:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307341:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307350:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307356:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307364:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307371:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307390:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307398:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307405:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307412:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307439:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307448:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307454:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307461:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307469:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307476:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307482:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307489:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307497:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307503:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307509:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307515:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307526:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307532:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307538:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307545:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307551:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307682:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307688:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307695:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307702:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307723:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307729:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307735:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307757:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307764:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307775:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307781:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307885:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307892:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307901:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307911:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307923:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307939:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307952:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307984:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.307993:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308002:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308011:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308027:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308034:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308049:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308056:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308065:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308071:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308079:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308086:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308094:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308114:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672727.308121:0:13014:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789672727.314365:0:13014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672727.314395:0:13014:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789672727.314402:0:13014:0:(genops.c:885:class_export_put()) final put ffff9fa604b24000/MDS_uuid 00000020:00000080:3.0:1789672727.314408:0:13014:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa604b24000/MDS_uuid for MDS 00000020:01000000:3.0:1789672727.314418:0:13014:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789672727.314587:0:13014:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789672727.795734:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672728.818985:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672729.846894:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789672730.214500:0:13167:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789672730.226987:0:13167:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789672730.227056:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.227081:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.227089:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.227097:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.227180:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789672730.227216:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789672730.227254:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789672730.227260:0:13167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789672730.227268:0:13167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789672730.227281:0:13167:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb96000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789672730.227287:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789672730.227289:0:13167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789672730.227292:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789672730.232255:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.232278:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.232286:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.232293:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672730.235074:0:13015:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672730.235094:0:13015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672730.235110:0:13015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa600030600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672730.235116:0:13015:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672730.235128:0:13015:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672730.235137:0:13015:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672730.235144:0:13015:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789672730.235148:0:13015:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789672730.235152:0:13015:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789672730.236463:0:13015:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672730.236480:0:13015:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672730.236559:0:13015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672730.236569:0:13015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa600030600/0x2247cb9491d0882b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08832 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672730.236594:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672730.236623:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564335232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672730.236713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672730.236815:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564335232 00000100:00100000:0.0:1789672730.236843:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564335232 00000100:00100000:0.0:1789672730.236896:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672730.236905:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3302:x1876607564335232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789672730.236911:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789672730 with bad export cookie 2470166759597966591 00010000:00010000:3.0:1789672730.241557:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672730.241621:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.241637:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.241646:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.241667:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672730.241690:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789672730.241697:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789672730.241735:0:13167:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789672730.241742:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789672730.241749:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672730.241757:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789672730.241762:0:13167:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9fa63a3acd40) has no exports 00000020:00080000:3.0:1789672730.241832:0:13167:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9fa63a3acd40) has no exports 00010000:00010000:2.0:1789672730.242214:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672730.242225:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242246:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929e200 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672730.242250:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242261:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672730.242268:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672730.242275:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672730.242278:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789672730.242281:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789672730.242327:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242334:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672730.242380:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242388:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929e200/0x2247cb9491d08839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08840 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242401:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672730.242405:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242411:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ea00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672730.242413:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242427:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672730.242433:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672730.242439:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789672730.242441:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789672730.242443:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789672730.242461:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242467:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672730.242484:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242491:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63542ea00/0x2247cb9491d08a62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2247cb9491d08a69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672730.242501:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672730.242503:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672730.242505:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672730.242530:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564335360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672730.242619:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672730.242702:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564335488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672730.242730:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672730.242776:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564335360 00000100:00100000:2.0:1789672730.242808:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564335360 00000100:00100000:2.0:1789672730.242842:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564335488 00000100:00100000:2.0:1789672730.242852:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564335488 00000100:00100000:2.0:1789672730.244308:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789672730.244319:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6118b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1876607564335360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789672730.244328:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789672730 with bad export cookie 2470166759597966591 00000100:00100000:2.0:1789672730.244425:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6118b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1876607564335360:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1805us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789672730.244434:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789672730.244454:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672730.244459:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1876607564335488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789672730.244463:0:5815:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789672730 with bad export cookie 2470166759597966591 00000100:00100000:2.0:1789672730.244494:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3299:x1876607564335488:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1763us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789672730.244500:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789672730.244546:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789672730.244552:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fa61a6ea800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789672730.244556:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1789672730.250041:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672730.250054:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672730.250056:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789672730.251743:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa6119c3a20 - data ffff9fa629fb4e58/ffff9fa62f5ea400 00000020:01000000:3.0:1789672730.251965:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa604ad5660 - data ffff9fa629f235e8/ffff9fa63f898400 00010000:00010000:1.0:1789672730.252909:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672730.255576:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3302:x1876607564335232:12345-0@lo:103:ldlm_bl.0 Request processed in 18663us (18855us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789672730.255593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789672730.266957:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789672730.275621:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.139@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789672730.275630:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789672730.275644:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa6352cf800 x1876607564335232/t0(0) o103->MGC192.168.202.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789672746 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672730.275663:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa63a219880 x1876607564335360/t0(0) o103->MGC192.168.202.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789672746 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672730.275674:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa63a21ad80 x1876607564335488/t0(0) o103->MGC192.168.202.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789672746 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789672730.275685:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789672730.275688:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789672730.275690:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789672730.275808:0:3302:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fa61a6ea800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789672730.275918:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564335232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672730.275956:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c6595f6-f042-46a8-abe4-2c10b8a32248:3302:1876607564335360:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789672730.276073:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9fa61a6ea800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672730.276080:0:3299:0:(import.c:545:import_select_connection()) MGC192.168.202.139@tcp: connect to NID 0@lo last attempt 172 00000100:00080000:2.0:1789672730.276212:0:3299:0:(import.c:666:import_select_connection()) MGC192.168.202.139@tcp: import ffff9fa61a6ea800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:2.0:1789672730.276253:0:3299:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63a219f80 x1876607564335616/t0(0) o250->MGC192.168.202.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672730.276314:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c6595f6-f042-46a8-abe4-2c10b8a32248:3298:1876607564335616:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789672730.276388:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876607564335616 offset 0 length 520: 4 00000100:00100000:2.0:1789672730.276462:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c6595f6-f042-46a8-abe4-2c10b8a32248:3299:1876607564335488:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1789672730.285693:0:13167:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789672730.314615:0:13167:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d0863a 00000020:00000080:3.0:1789672730.314627:0:13167:0:(genops.c:885:class_export_put()) final put ffff9fa63f8cc800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789672730.314648:0:13167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa6117c1000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789672730.314651:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa6117c1000 2 00000020:01000004:3.0:1789672730.314654:0:13167:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa6117c1000 from lustre-OST0000 00000020:00000080:3.0:1789672730.314683:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672730.314694:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789672730.314696:0:13167:0:(genops.c:885:class_export_put()) final put ffff9fa63f8ce800/lustre-OST0000_UUID 00000020:00000080:3.0:1789672730.314699:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63f8ce800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789672730.314706:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789672730.314745:0:13167:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789672730.314749:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789672730.314764:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672730.314769:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789672730.314777:0:13167:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fa63fb97800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789672730.314811:0:13167:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9fa62f1e0000) has exports, disconnecting them 00000020:00080000:3.0:1789672730.314818:0:13167:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fa63fb97800), last request at 1789672520 00000020:00000080:3.0:1789672730.314823:0:13167:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08664 00000020:00080000:3.0:1789672730.314833:0:13167:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa63fb97800): rc 0 00000020:00000080:3.0:1789672730.314838:0:13167:0:(genops.c:885:class_export_put()) final put ffff9fa63fb97800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789672730.315544:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63f8cc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789672730.315561:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63fb97800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789672730.315886:0:13167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789672730.315891:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672730.315896:0:13167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789672730.315902:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789672730.316032:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672730.316036:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789672730.316041:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa6117c1000 1 00000020:00000080:2.0:1789672730.316045:0:13167:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d085f4 00000020:00000080:2.0:1789672730.316050:0:13167:0:(genops.c:885:class_export_put()) final put ffff9fa6117c3000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789672730.316054:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789672730.316058:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672730.316060:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789672730.316062:0:13167:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9fa6103d99c0) has no exports 00000020:00000080:1.0:1789672730.316133:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa63fb96000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789672730.316140:0:36:0:(genops.c:885:class_export_put()) final put ffff9fa639b2b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789672730.316142:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639b2b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789672730.316146:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789672730.316189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa6117c3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789672730.325112:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672730.325136:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789672730.325144:0:13167:0:(genops.c:885:class_export_put()) final put ffff9fa6117c0000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789672730.325149:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa6117c0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789672730.325159:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789672730.325383:0:13167:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa6117c6000 00000020:02000400:1.0:1789672730.325445:0:13167:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1789672730.549739:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789672730.549754:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789672730.549758:0:469:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789672730.549769:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 394 00000100:00080000:3.0:1789672730.549777:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789672730.549807:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa62f3d6800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:3.0:1789672730.549855:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa62f0f6a00 x1876607564335744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672730.549908:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564335744:0@lo:38:kworker.0 00000400:00000100:3.0:1789672730.549973:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607564335744 offset 0 length 520: 4 00010000:00010000:1.0:1789672730.869085:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672731.895756:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672732.916858:0:13015:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789672733.037616:0:13316:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789672733.053991:0:13316:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789672733.054124:0:13316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.054139:0:13316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.054147:0:13316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.054171:0:13316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.054226:0:13316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789672733.054231:0:13316:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789672733.054252:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672733.054261:0:13316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa62f0f6a00 x1876607564335744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672745 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672733.054277:0:13316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789672733.054283:0:13316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789672733.054289:0:13316:0:(import.c:65:import_set_state_nolock()) ffff9fa62f3d6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789672733.054293:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672733.054296:0:13316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa62f0f6a00 x1876607564335744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672745 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672733.054307:0:13316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789672733.054309:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1789672733.054396:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564335744:0@lo:38:kworker.0 00010000:00010000:1.0:1789672733.054495:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672733.054562:0:8499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.054571:0:8499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929e600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672733.054575:0:8499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.054584:0:8499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672733.054599:0:8499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672733.054606:0:8499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789672733.054609:0:8499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789672733.054611:0:8499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789672733.054633:0:8499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa61a6ea800 00010000:00010000:1.0:1789672733.054637:0:8499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.054644:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929e600/0x2247cb9491d0880f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d08816 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.054751:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672733.054754:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672733.054756:0:8499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672733.055396:0:13316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.055407:0:13316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.055414:0:13316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.055421:0:13316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.055447:0:13316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672733.055454:0:13316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.055460:0:13316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.055465:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672733.055466:0:13316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.055470:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672733.055472:0:13316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.055477:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f800 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672733.055480:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.055487:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672733.055494:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672733.055520:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789672733.055523:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789672733.055527:0:13316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672733.055529:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa61a6ea800 10000000:01000000:2.0:1789672733.055531:0:13316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789672733.055532:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672733.055534:0:13316:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1789672733.055539:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d0881d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d08824 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.055548:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:2.0:1789672733.055550:0:13316:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1789672733.055551:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789672733.055554:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1789672733.055556:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672733.055558:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789672733.055559:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672733.055564:0:13316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1789672733.055565:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789672733.055568:0:13316:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9fa611ca8000) has no exports 10000000:00010000:1.0:1789672733.055571:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672733.055575:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789672733.055577:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789672733.055578:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789672733.055582:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa61a6ea800 00010000:00010000:1.0:1789672733.055584:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789672733.055589:0:13316:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9fa611ca8000) has no exports 00010000:00010000:1.0:1789672733.055598:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa61d911400/0x2247cb9491d08a54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d08a5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672733.055609:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672733.055611:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672733.055638:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672733.056098:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789672733.057731:0:13316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa604a66000 - data ffff9fa630f4da20/ffff9fa633181c00 00000020:01000000:2.0:1789672733.057914:0:13316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa639e26c00 - data ffff9fa630f25d80/ffff9fa62f55ac00 00100000:10000000:2.0:1789672733.075102:0:13316:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789672733.103616:0:13316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d08705 00000020:00000080:3.0:1789672733.103627:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa639da5000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789672733.103644:0:13316:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa63fb87000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789672733.103648:0:13316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa63fb87000 2 00000020:01000004:3.0:1789672733.103651:0:13316:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa63fb87000 from lustre-OST0001 00000020:00000080:0.0:1789672733.103652:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639da5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789672733.103949:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672733.103961:0:13316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789672733.103973:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa63adc5000/lustre-OST0001_UUID 00000020:00000080:3.0:1789672733.103976:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63adc5000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789672733.103983:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789672733.104312:0:13316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3c6595f6-f042-46a8-abe4-2c10b8a32248->MGS 00010000:00010000:3.0:1789672733.104337:0:13316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672733.104349:0:13316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672733.104356:0:13316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789672733.104359:0:13316:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789672733.104362:0:13316:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789672733.104376:0:13316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa61a6ea800 00010000:00010000:3.0:1789672733.104380:0:13316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6421ee600/0x2247cb9491d08617 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d0861e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672733.104395:0:13316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672733.104405:0:13316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672733.104410:0:13316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789672733.104412:0:13316:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789672733.104413:0:13316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789672733.104421:0:13316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa61a6ea800 00010000:00010000:3.0:1789672733.104424:0:13316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa6208f3400/0x2247cb9491d08863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2247cb9491d0886a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789672733.104438:0:13316:0:(import.c:65:import_set_state_nolock()) ffff9fa61a6ea800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789672733.104446:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789672733.104449:0:13316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789672733.104450:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789672733.104455:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789672733.104466:0:13316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa63a219f80 x1876607564335616/t0(0) o250->MGC192.168.202.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789672740 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789672733.104593:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789672733.104596:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1789672733.106615:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c6595f6-f042-46a8-abe4-2c10b8a32248:3298:1876607564335616:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:3.0:1789672733.110334:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789672733.110351:0:13316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d084f8 00000020:00000080:3.0:1789672733.110360:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa61a6ee800/3c6595f6-f042-46a8-abe4-2c10b8a32248 00000020:01000000:3.0:1789672733.110381:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.139@tcp (flags='') 00000020:00000080:3.0:1789672733.110390:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672733.110397:0:13316:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789672733.110401:0:13316:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9fa6103db380) has no exports 00000020:00000080:1.0:1789672733.110822:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa61a6ee800/3c6595f6-f042-46a8-abe4-2c10b8a32248 for MGC192.168.202.139@tcp 10000000:01000000:3.0:1789672733.112508:0:5827:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789672733.112825:0:13316:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.139@tcp: client import never connected 00000100:00080000:1.0:1789672733.112830:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789672733.112834:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789672733.112837:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789672733.112840:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789672733.112880:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672733.112888:0:13316:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.139@tcp (uuid 3c6595f6-f042-46a8-abe4-2c10b8a32248) 00000020:01000000:1.0:1789672733.112896:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789672733.112902:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672733.112907:0:13316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789672733.112914:0:13316:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fa62f3d0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789672733.112921:0:13316:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9fa62f3c4d40) has exports, disconnecting them 00000020:00080000:1.0:1789672733.112925:0:13316:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fa62f3d0800), last request at 1789672537 00000020:00000080:1.0:1789672733.112929:0:13316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d0872f 00000020:00080000:1.0:1789672733.112943:0:13316:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa62f3d0800): rc 0 00000020:00000080:1.0:1789672733.112948:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa62f3d0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789672733.113817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa62f3d0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789672733.113828:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa61a6ea800 for MGC192.168.202.139@tcp 00000020:00000080:3.0:1789672733.113833:0:36:0:(genops.c:885:class_export_put()) final put ffff9fa61a6ec800/3c6595f6-f042-46a8-abe4-2c10b8a32248 00000020:00000080:3.0:1789672733.113836:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa61a6ec800/3c6595f6-f042-46a8-abe4-2c10b8a32248 for MGC192.168.202.139@tcp 00000020:01000000:3.0:1789672733.113840:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.139@tcp (3c6595f6-f042-46a8-abe4-2c10b8a32248) 00010000:01000000:0.0:1789672733.114837:0:13316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789672733.114842:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672733.114845:0:13316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789672733.114850:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789672733.116869:0:13015:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789672733.117276:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9fa62f3d6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789672733.118823:0:8499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789672733.118985:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789672733.120823:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1789672733.120921:0:5813:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fa6107fce00:5813] 0 exiting: rc = 1 00000100:00100000:2.0:1789672733.121045:0:5814:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fa610625600:5814] 1 exiting: rc = 0 00000100:00100000:3.0:1789672733.121116:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.121313:0:5815:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fa610625c00:5815] 0 exiting: rc = 1 00000100:00100000:1.0:1789672733.121337:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fa6184fe800:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1789672733.121373:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fa6184ff000:5817] 2 exiting: rc = 0 00000100:00100000:1.0:1789672733.121385:0:11163:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fa6107eda00:11163] 3 exiting: rc = 0 00000100:00100000:3.0:1789672733.121464:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121472:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121477:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121483:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121489:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121497:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121503:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121509:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121527:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121533:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121538:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121544:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121549:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121554:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121560:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121567:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121571:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121575:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121579:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121582:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121585:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121589:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121592:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121595:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121597:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121600:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121603:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121605:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121608:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121611:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121613:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121616:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121619:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121623:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121627:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121632:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121637:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121641:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121645:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121650:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121655:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121659:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121664:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121676:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121681:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121684:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121687:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121690:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121694:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121696:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121700:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121706:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121711:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121716:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121720:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121725:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121730:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121736:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121741:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121747:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121752:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121756:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121759:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.121763:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789672733.122482:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672733.122491:0:13316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789672733.122501:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa63adc3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789672733.122505:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63adc3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789672733.122511:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789672733.122549:0:13316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa63fb87000 1 00000020:00000080:3.0:1789672733.122555:0:13316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2247cb9491d086d4 00000020:00000080:3.0:1789672733.122561:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa63f8cd000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789672733.122571:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789672733.122575:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672733.122577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa63f8cd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789672733.122580:0:13316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789672733.122583:0:13316:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9fa611cab380) has no exports 00000020:00000080:0.0:1789672733.132826:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672733.132842:0:13316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789672733.132847:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa639b3d800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789672733.132851:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa639b3d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789672733.132859:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789672733.133035:0:13316:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa639b3a800 00000020:01000000:0.0:1789672733.133054:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789672733.133057:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672733.133061:0:13316:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789672733.133065:0:13316:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9fa62f1e3380) has no exports 00000020:00000080:0.0:1789672733.133088:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672733.133093:0:13316:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789672733.133096:0:13316:0:(genops.c:885:class_export_put()) final put ffff9fa6117c4000/OSS_uuid 00000020:00000080:0.0:1789672733.133098:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa6117c4000/OSS_uuid for OSS 00000020:01000000:0.0:1789672733.133101:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789672733.133171:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9fa6107e9800:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1789672733.133246:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9fa6107e8a00:6685] 2 exiting: rc = 0 00000100:00100000:0.0:1789672733.133286:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9fa6107e9600:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1789672733.133340:0:8063:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9fa61191c600:8063] 3 exiting: rc = 0 00000100:00080000:3.0:1789672733.133349:0:5826:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789672733.133399:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133408:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133414:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133420:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133426:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133431:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133436:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133450:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133456:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133462:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133467:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133472:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133477:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133482:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133487:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133492:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133497:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133502:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133507:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133512:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133524:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133529:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133534:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133540:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133545:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133550:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133556:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133561:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133566:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133571:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133576:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133581:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133586:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133591:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133596:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133600:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133605:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133610:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133614:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.133619:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134052:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134059:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134065:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134070:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134075:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134079:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134084:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134089:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134094:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134099:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134104:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134112:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134117:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134122:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134126:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134138:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134143:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134148:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134152:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134157:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134162:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134167:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134171:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.134176:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.135290:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fa61030a600:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1789672733.135303:0:11684:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fa63f836200:11684] 2 exiting: rc = 0 00000100:00100000:3.0:1789672733.135360:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fa611968000:6686] 0 exiting: rc = 1 00000100:00100000:0.0:1789672733.135429:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135438:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135443:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135448:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135454:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135459:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135465:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135470:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135475:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135480:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135485:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135490:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135495:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135500:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135504:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135509:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135514:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135518:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135522:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135526:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135531:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135536:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135542:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135548:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135553:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135558:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135571:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135575:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135578:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135582:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135585:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135588:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135591:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135594:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135597:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135600:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135603:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135606:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135610:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135613:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135617:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135620:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135622:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135681:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135684:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135687:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135691:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135694:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135697:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135747:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135752:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135755:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135758:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135761:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135765:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135768:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135771:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135774:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135776:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135779:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135843:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135858:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135863:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672733.135869:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672733.136608:0:11985:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9fa61d900800:11985] 3 exiting: rc = 0 00000100:00100000:3.0:1789672733.136645:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fa6118fc600:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1789672733.136985:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fa611907000:6690] 2 exiting: rc = 0 00000100:00100000:3.0:1789672733.137005:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fa61030ac00:6688] 0 exiting: rc = 1 00000100:00100000:2.0:1789672733.137060:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137075:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137081:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137087:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137093:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137098:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137104:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137109:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137115:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137120:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137125:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137130:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137136:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137141:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137145:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137149:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137152:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137156:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137166:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137170:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137174:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137177:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137181:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137185:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137189:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137192:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137196:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137199:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137203:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137206:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137209:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137213:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137217:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137220:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137224:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137227:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137235:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137238:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137241:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137245:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137248:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137252:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137264:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137268:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137272:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137276:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137280:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137283:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137286:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137290:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137293:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137296:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137299:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137303:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137307:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137317:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137336:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137342:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137352:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137357:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137362:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137368:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137373:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.137378:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.140289:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fa611906800:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1789672733.140359:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fa611906a00:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1789672733.140445:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140451:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140454:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140457:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140460:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140465:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140468:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140476:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140479:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140483:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140486:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140489:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140492:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140495:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140506:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140509:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140512:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140515:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140518:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140521:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140524:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140529:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140533:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140537:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140540:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140543:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140546:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140548:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140551:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140554:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140557:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140560:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140563:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140566:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140568:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140571:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140574:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140577:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140580:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140583:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140586:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140589:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140597:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140600:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140603:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140607:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140610:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140613:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140616:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140618:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140621:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140625:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140630:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140635:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140640:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140645:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140649:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140654:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140659:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140664:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140669:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140675:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140680:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.140690:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672733.141278:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fa611906400:6694] 1 exiting: rc = 0 00000100:00100000:0.0:1789672733.141380:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fa61a794c00:6693] 0 exiting: rc = 1 00000100:00100000:2.0:1789672733.141429:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141441:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141446:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141450:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141453:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141457:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141461:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141465:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141469:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141473:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141483:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141487:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141490:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141543:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141547:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141551:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141554:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141558:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141562:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141566:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141570:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141574:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141587:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141592:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141595:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141600:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141604:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141608:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141611:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141615:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141619:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141622:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141627:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141634:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141655:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141662:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141668:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141674:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141681:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141687:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141692:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141696:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141701:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141707:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141713:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141717:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141737:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141743:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141755:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141759:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141763:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141767:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141770:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141774:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141779:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141861:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141869:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141879:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141901:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141916:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141929:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141935:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141940:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672733.141946:0:13316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789672733.148611:0:13316:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789672755.174766:0:13932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789672766.677909:0:14393:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789672766.677915:0:14393:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789672766.678037:0:14393:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa6186e7800 00000020:01000004:3.0:1789672766.678052:0:14393:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789672766.678060:0:14393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789672766.678073:0:14393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fa63a3acd40) 00000020:00000080:3.0:1789672766.678085:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789672766.699626:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789672766.708455:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789672766.709052:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 101: rc = 0 00100000:10000000:2.0:1789672766.709150:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 101: rc = 0 00100000:10000000:2.0:1789672766.709319:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 101: rc = 0 00100000:10000000:2.0:1789672766.709396:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 101: rc = 0 00100000:10000000:2.0:1789672766.709474:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 101: rc = 0 00100000:10000000:2.0:1789672766.709928:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789672766.709989:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 101: rc = 0 00100000:10000000:2.0:1789672766.710299:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 103: rc = 0 00100000:10000000:2.0:1789672766.711596:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:2.0:1789672766.711672:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:2.0:1789672766.712332:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 370: rc = 0 00100000:10000000:2.0:1789672766.712547:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 370: rc = 0 00100000:10000000:2.0:1789672766.712848:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 370: rc = 0 00100000:10000000:2.0:1789672766.713157:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 370: rc = 0 00100000:10000000:2.0:1789672766.713470:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 370: rc = 0 00100000:10000000:2.0:1789672766.713934:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 370: rc = 0 00100000:10000000:2.0:1789672766.714268:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 370: rc = 0 00100000:10000000:2.0:1789672766.714506:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 370: rc = 0 00100000:10000000:0.0:1789672766.717138:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 370: rc = 0 00100000:10000000:0.0:1789672766.717428:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 370: rc = 0 00100000:10000000:0.0:1789672766.717822:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 370: rc = 0 00100000:10000000:0.0:1789672766.718076:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 370: rc = 0 00100000:10000000:0.0:1789672766.718506:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 123: rc = 0 00100000:10000000:0.0:1789672766.719354:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 123: rc = 0 00100000:10000000:0.0:1789672766.719581:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 123: rc = 0 00100000:10000000:0.0:1789672766.720437:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 123: rc = 0 00100000:10000000:0.0:1789672766.720673:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 123: rc = 0 00100000:10000000:0.0:1789672766.722321:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 123: rc = 0 00100000:10000000:1.0:1789672766.722778:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 123: rc = 0 00100000:10000000:1.0:1789672766.723118:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 123: rc = 0 00100000:10000000:1.0:1789672766.724323:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 123: rc = 0 00100000:10000000:1.0:1789672766.724601:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 123: rc = 0 00100000:10000000:1.0:1789672766.725066:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 123: rc = 0 00100000:10000000:1.0:1789672766.725317:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 123: rc = 0 00100000:10000000:1.0:1789672766.725552:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 123: rc = 0 00100000:10000000:1.0:1789672766.725827:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 123: rc = 0 00100000:10000000:1.0:1789672766.726076:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 123: rc = 0 00100000:10000000:1.0:1789672766.726304:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 123: rc = 0 00100000:10000000:1.0:1789672766.726537:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 123: rc = 0 00100000:10000000:1.0:1789672766.726775:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 123: rc = 0 00100000:10000000:1.0:1789672766.726991:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 123: rc = 0 00100000:10000000:1.0:1789672766.730393:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 123: rc = 0 00100000:10000000:1.0:1789672766.730642:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 123: rc = 0 00100000:10000000:1.0:1789672766.730930:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 123: rc = 0 00100000:10000000:1.0:1789672766.731405:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 123: rc = 0 00100000:10000000:1.0:1789672766.731642:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 123: rc = 0 00100000:10000000:1.0:1789672766.733108:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 123: rc = 0 00100000:10000000:1.0:1789672766.733520:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 123: rc = 0 00100000:10000000:1.0:1789672766.733761:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 123: rc = 0 00100000:10000000:1.0:1789672766.734065:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 123: rc = 0 00100000:10000000:1.0:1789672766.734301:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 123: rc = 0 00100000:10000000:1.0:1789672766.734560:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 123: rc = 0 00100000:10000000:1.0:1789672766.734832:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 123: rc = 0 00100000:10000000:1.0:1789672766.736573:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 123: rc = 0 00100000:10000000:1.0:1789672766.737148:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 526: rc = 0 00100000:10000000:1.0:1789672766.737745:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789672766.738424:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:1.0:1789672766.738620:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789672766.738686:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:1.0:1789672766.739064:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789672766.739129:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:1.0:1789672766.740511:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789672766.740591:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:1.0:1789672766.740771:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789672766.741902:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:1.0:1789672766.742150:0:14393:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1789672766.742434:0:14393:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00000020:00000080:1.0:1789672766.742690:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789672766.742700:0:14393:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789672766.742710:0:14393:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d097eb 00000020:01000004:1.0:1789672766.742717:0:14393:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789672766.742722:0:14393:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789672766.742727:0:14393:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa6186e7800 from MGS 00000020:01000004:1.0:1789672766.742730:0:14393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789672766.742739:0:14393:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fa62f3c19c0) 00000020:00000080:1.0:1789672766.742749:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789672766.742978:0:14393:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa6186e7800 from MGS, refs=2 00080000:01000000:1.0:1789672766.742983:0:14393:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789672766.742988:0:14393:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d097f9 00000100:00100000:1.0:1789672766.743089:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789672766.743773:0:14393:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789672766.743779:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789672766.744947:0:14393:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789672766.744956:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789672766.747683:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672766.747995:0:14393:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789672766.748010:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789672766.751019:0:14393:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789672766.751035:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789672766.751626:0:14393:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789672766.751634:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789672766.752595:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672766.752599:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672766.752601:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672766.758276:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672766.758283:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672766.758286:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672766.758844:0:14393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789672766.761119:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789672766.775439:0:14393:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789672766.775458:0:14393:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789672766.775461:0:14393:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789672766.780398:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789672766.780625:0:14393:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789672766.780740:0:14393:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789672766.781269:0:14393:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789672766.781560:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672766.781719:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789672766.781725:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789672766.790476:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789672766.790488:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789672766.790989:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789672766.790997:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789672766.791737:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789672766.791759:0:14393:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.139@tcp' 00000020:01000004:0.0:1789672766.791761:0:14393:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789672766.791822:0:14393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.139@tcp (typ=mgc) 00000020:00000080:0.0:1789672766.791833:0:14393:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.139@tcp (ffff9fa611cab380) 00000020:00000080:0.0:1789672766.791847:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1789672766.791962:0:14407:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1789672766.792310:0:14393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa502919800@MGC192.168.202.139@tcp: add connection 192.168.202.139@tcp at head 00010000:00010000:0.0:1789672766.792468:0:14393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.139@tcp-0 is initialized 00000040:01000000:0.0:1789672766.792484:0:14393:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789672766.794540:0:14408:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789672766.794632:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.139@tcp (uuid 994b4890-4fae-4a7b-b1da-2d17fd8dcbb1) 00000020:00000080:1.0:1789672766.794661:0:14393:0:(genops.c:1384:class_connect()) connect: client 994b4890-4fae-4a7b-b1da-2d17fd8dcbb1, cookie 0x2247cb9491d09807 00000100:00080000:1.0:1789672766.794674:0:14393:0:(import.c:545:import_select_connection()) MGC192.168.202.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672766.794685:0:14393:0:(import.c:666:import_select_connection()) MGC192.168.202.139@tcp: import ffff9fa502919800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672766.794722:0:14393:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63f783100 x1876607564335872/t0(0) o250->MGC192.168.202.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672766.794750:0:14393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 994b4890-4fae-4a7b-b1da-2d17fd8dcbb1->MGS 00000020:01000004:1.0:1789672766.794769:0:14393:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789672766.794774:0:14393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789672766.794809:0:14393:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fa62f3c3380) 00000020:00000080:1.0:1789672766.794825:0:14393:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789672766.794987:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3298:1876607564335872:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789672766.795061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672766.795185:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564335872 00000100:00100000:3.0:1789672766.795193:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564335872 00000100:00100000:3.0:1789672766.795225:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672766.795232:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1876607564335872:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789672766.795261:0:14404:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 994b4890-4fae-4a7b-b1da-2d17fd8dcbb1@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:3.0:1789672766.795283:0:14404:0:(genops.c:1384:class_connect()) connect: client 994b4890-4fae-4a7b-b1da-2d17fd8dcbb1, cookie 0x2247cb9491d09815 00000100:00080000:3.0:1789672766.795412:0:14404:0:(import.c:65:import_set_state_nolock()) ffff9fa641b94000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672766.795464:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+5:3298:x1876607564335872:12345-0@lo:250:mount.lustre.0 Request processed in 231us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672766.795471:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672766.795514:0:3298:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789672766.795522:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.139@tcp: connect to target with instance 0 00000100:00080000:3.0:1789672766.795528:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789672766.795532:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789672766.795535:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa502919800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789672766.795538:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789672766.795545:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789672766.795550:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3298:1876607564335872:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789672766.824578:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672766.824762:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789672766.824769:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789672766.827206:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789672766.827219:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789672766.827649:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789672766.827656:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789672766.828380:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672766.828563:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789672766.828569:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789672766.831673:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789672766.831690:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789672766.880890:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672766.881115:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789672766.881122:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789672766.882470:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789672766.882480:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789672766.885151:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672766.885366:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789672766.885373:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789672766.886628:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789672766.886639:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789672766.887429:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672766.887595:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789672766.887599:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789672766.889123:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789672766.889132:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789672766.890279:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672766.890451:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789672766.890456:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789672766.892619:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789672766.892633:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789672766.923135:0:14393:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672766.923416:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789672766.923423:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789672766.926062:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789672766.926075:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789672766.926953:0:14393:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789672766.926961:0:14393:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789672766.928946:0:14393:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789672766.928971:0:14393:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789672766.928976:0:14393:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789672766.929113:0:14393:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789672766.929154:0:14393:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.139@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789672766.929230:0:14393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789672766.929233:0:14393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672766.929234:0:14393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672766.929236:0:14393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672766.929237:0:14393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672766.929239:0:14393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672766.929240:0:14393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672766.929242:0:14393:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672766.929244:0:14393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672766.929245:0:14393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789672766.929248:0:14393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789672766.929250:0:14393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789672766.929251:0:14393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672766.929252:0:14393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672766.929254:0:14393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672766.929255:0:14393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672766.929261:0:14393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672766.929262:0:14393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672766.929263:0:14393:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672766.929264:0:14393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672766.929265:0:14393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789672766.929289:0:14393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789672766.929308:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789672766.929375:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672766.929472:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602ea3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672766.929587:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336000 00000100:00100000:2.0:1789672766.929594:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336000 00000100:00100000:2.0:1789672766.929636:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672766.929645:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+5:14393:x1876607564336000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789672766.929688:0:14406:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789672766.929691:0:14406:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789672766.929694:0:14406:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789672766.930168:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789672766.930590:0:14406:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789672766.931648:0:14428:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789672766.931660:0:14428:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789672766.931663:0:14428:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789672766.931721:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789672766.932040:0:14406:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789672766.932051:0:14406:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789672766.955646:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+5:14393:x1876607564336000:12345-0@lo:253:mount.lustre.0 Request processed in 25992us (26261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672766.955662:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672766.955760:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789672766.955777:0:14393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789672766.955781:0:14393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789672766.955783:0:14393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672766.955804:0:14393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672766.955805:0:14393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672766.955807:0:14393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672766.955808:0:14393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672766.955809:0:14393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672766.955810:0:14393:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672766.955812:0:14393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672766.955814:0:14393:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789672766.955835:0:14393:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa6186e7800 from lustre-MDT0000 10000000:01000000:1.0:1789672766.955911:0:14393:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789672766.955915:0:14393:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789672766.955919:0:14393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fa611cab380 10000000:01000000:1.0:1789672766.955923:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789672766.955931:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa611cab380 from 1 10000000:01000000:1.0:1789672766.955934:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789672766.955974:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.955984:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.956020:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672766.956039:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789672766.956075:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672766.956125:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789672766.957489:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336128 00000100:00100000:3.0:1789672766.957501:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336128 00000100:00100000:3.0:1789672766.957558:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672766.957568:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+5:14393:x1876607564336128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672766.957595:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672766.957615:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67cc00/0x2247cb9491d09823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0981c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672766.957641:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67cc00/0x2247cb9491d09823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0981c expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672766.957653:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67cc00/0x2247cb9491d09823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0981c expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672766.957661:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67cc00, rc 0) 00000100:00100000:3.0:1789672766.957738:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+6:14393:x1876607564336128:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672766.957744:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672766.957912:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789672766.957929:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672766.957939:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672766.958028:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672766.958060:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672766.958083:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602ea3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672766.958186:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336256 00000100:00100000:2.0:1789672766.958193:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336256 00000100:00100000:2.0:1789672766.958229:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672766.958239:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+6:14393:x1876607564336256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672766.958677:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+6:14393:x1876607564336256:12345-0@lo:501:mount.lustre.0 Request processed in 439us (615us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672766.958685:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672766.959297:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336256:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789672766.959336:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789672766.959357:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672766.959367:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672766.959377:0:14393:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa6186e7800 10000000:01000000:1.0:1789672766.959497:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789672766.959505:0:14393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fa6186e7800 10000000:01000000:1.0:1789672766.959508:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789672766.959511:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fa6186e7800 from 1 10000000:01000000:1.0:1789672766.959514:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789672766.959543:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.959552:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.959560:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672766.959577:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789672766.959619:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672766.959660:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672766.959768:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336384 00000100:00100000:2.0:1789672766.959774:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336384 00000100:00100000:2.0:1789672766.959834:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672766.959843:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+6:14393:x1876607564336384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672766.959852:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672766.959865:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929f000/0x2247cb9491d09831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0982a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672766.959883:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929f000/0x2247cb9491d09831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0982a expref: 7 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672766.959893:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929f000/0x2247cb9491d09831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0982a expref: 7 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672766.959901:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929f000, rc 0) 00000100:00100000:2.0:1789672766.959943:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+7:14393:x1876607564336384:12345-0@lo:101:mount.lustre.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672766.959959:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672766.960056:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789672766.960068:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09831 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.960077:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09831 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672766.960296:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789672766.960311:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09831 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.960318:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542e200/0x2247cb9491d0982a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09831 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672766.960324:0:14393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789672766.960327:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789672766.960332:0:14393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fa6186e7800 10000000:01000000:1.0:1789672766.960335:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789672766.960339:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789672766.960341:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789672766.960359:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.960366:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.960374:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672766.960386:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789672766.960546:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672766.960618:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63fcb4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672766.966511:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336512 00000100:00100000:0.0:1789672766.966529:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336512 00000100:00100000:1.0:1789672766.966819:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672766.966832:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+7:14393:x1876607564336512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789672766.966861:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672766.966881:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542fe00/0x2247cb9491d0983f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09838 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.966910:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542fe00/0x2247cb9491d0983f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09838 expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.966922:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542fe00/0x2247cb9491d0983f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09838 expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672766.966931:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fe00, rc 0) 00000100:00100000:1.0:1789672766.967027:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+8:14393:x1876607564336512:12345-0@lo:101:mount.lustre.0 Request processed in 198us (6480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672766.967034:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672766.967142:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672766.967159:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0983f expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672766.967170:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0983f expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672766.967253:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672766.967285:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672766.967324:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa639d48b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672766.967552:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336640 00000100:00100000:3.0:1789672766.967557:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336640 00000100:00100000:3.0:1789672766.967597:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672766.967605:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+8:14393:x1876607564336640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672766.968076:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14393:x1876607564336640:12345-0@lo:501:mount.lustre.0 Request processed in 471us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672766.968083:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672766.968124:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672766.968163:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672766.968212:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672766.968230:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa639d48b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672766.968338:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336768 00000100:00100000:3.0:1789672766.968344:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336768 00000100:00100000:3.0:1789672766.968363:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672766.968369:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14393:x1876607564336768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789672766.969600:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14393:x1876607564336768:12345-0@lo:503:mount.lustre.0 Request processed in 1227us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672766.969622:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789672766.969663:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564336768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672766.970164:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14429:1876607564336896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672766.970222:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672766.970255:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa639d48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672766.970738:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564336896 00000100:00100000:0.0:1789672766.970746:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564336896 00000100:00100000:0.0:1789672766.970820:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672766.970830:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14429:x1876607564336896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672766.971145:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14429:x1876607564336896:12345-0@lo:502:llog_process_th.0 Request processed in 316us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672766.971152:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789672766.971710:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14429:1876607564336896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672766.971745:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672766.971756:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672766.971759:0:14429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789672766.971763:0:14429:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789672766.971773:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672766.971810:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fa62f1e3380) 00000020:00000080:2.0:1789672766.971829:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789672766.971836:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789672766.971907:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789672766.971916:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d0984d 00000020:00000080:2.0:1789672766.972143:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789672766.972147:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672766.972151:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672766.972152:0:14429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789672766.972155:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672766.972158:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672766.972159:0:14429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789672766.972162:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672766.972169:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fa62f1e4d40) 00000020:00000080:2.0:1789672766.972283:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789672766.972290:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789672766.972292:0:14429:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789672766.972294:0:14429:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789672766.972300:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789672766.972338:0:14429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa6186e7800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789672766.972350:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fa62f1e19c0) 00000020:00000080:2.0:1789672766.972358:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789672766.972545:0:14429:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789672766.972553:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d09862 00000020:00000080:2.0:1789672766.972648:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789672766.972653:0:14429:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789672766.972658:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2247cb9491d09869 00080000:01000000:2.0:1789672766.972663:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789672766.972667:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d09870 00010000:00010000:2.0:1789672767.127107:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789672767.127750:0:14429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789672767.127991:0:14429:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789672767.129044:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fa62f1e0000) 00000020:00000080:2.0:1789672767.129067:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789672767.129138:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789672767.129145:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d0987e 00000020:00000080:0.0:1789672767.135372:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789672767.143107:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2247cb9491d09885 00000020:00000080:2.0:1789672767.144069:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789672767.144086:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672767.144094:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.144096:0:14429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789672767.144099:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672767.144105:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.144106:0:14429:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789672767.144111:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789672767.144148:0:14429:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789672767.144163:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672767.144167:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.144168:0:14429:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789672767.144171:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789672767.144173:0:14429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789672767.144175:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789672767.144187:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789672767.144188:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789672767.144191:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.144193:0:14429:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789672767.144195:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789672767.144198:0:14429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789672767.144202:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.144203:0:14429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789672767.144206:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789672767.144211:0:14429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.139@tcp to nid 0x20000c0a8ca8b (192.168.202.139@tcp) 00000020:01000000:2.0:1789672767.144240:0:14429:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789672767.144243:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672767.144259:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fa6103db380) 00000020:00000080:2.0:1789672767.144274:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789672767.144288:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789672767.144342:0:14429:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789672767.144348:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789672767.144356:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d09893 00010000:00080000:2.0:1789672767.144389:0:14429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa6031e7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.139@tcp at head 00010000:00010000:2.0:1789672767.144736:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789672767.145464:0:14429:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789672767.145586:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789672767.152571:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789672767.152644:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789672767.152730:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789672767.157985:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789672767.157993:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789672767.161613:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789672767.161639:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789672767.161676:0:14429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789672767.161696:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d0989a 00000100:00080000:2.0:1789672767.161707:0:14429:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672767.161718:0:14429:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa6031e7800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:2.0:1789672767.161759:0:14429:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63a21ad80 x1876607564337024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672767.161850:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564337024:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789672767.161857:0:14429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000400:00000100:3.0:1789672767.161897:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607564337024 offset 0 length 520: 4 00000020:01000000:2.0:1789672767.161924:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672767.161930:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.161932:0:14429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789672767.161935:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789672767.161937:0:14429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789672767.161939:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789672767.161940:0:14429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789672767.161941:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789672767.161944:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.161946:0:14429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789672767.161948:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789672767.161951:0:14429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789672767.161960:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.161961:0:14429:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789672767.161964:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789672767.161967:0:14429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.139@tcp to nid 0x20000c0a8ca8b (192.168.202.139@tcp) 00000020:01000000:2.0:1789672767.161981:0:14429:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789672767.161983:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672767.161991:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fa6103d99c0) 00000020:00000080:2.0:1789672767.162013:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789672767.162018:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789672767.162072:0:14429:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789672767.162078:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789672767.162093:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2247cb9491d098a8 00010000:00080000:2.0:1789672767.162120:0:14429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa6209e6000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.139@tcp at head 00010000:00010000:2.0:1789672767.162329:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789672767.162516:0:14429:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789672767.162539:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789672767.163291:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672767.163365:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789672767.163422:0:14429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789672767.164090:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789672767.164096:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789672767.164660:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789672767.164669:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789672767.164692:0:14429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789672767.164710:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d098af 00000100:00080000:2.0:1789672767.164718:0:14429:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672767.164727:0:14429:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa6209e6000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:2.0:1789672767.164760:0:14429:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63a21b800 x1876607564337152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672767.164944:0:14429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789672767.165025:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672767.165029:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.165040:0:14429:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789672767.165045:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672767.165049:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.165051:0:14429:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789672767.165054:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789672767.165056:0:14429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789672767.165058:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672767.165060:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.165061:0:14429:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789672767.165063:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672767.165065:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.165066:0:14429:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789672767.165069:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789672767.165106:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a219180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14429:1876607564337280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672767.165192:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672767.165225:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61db589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672767.165354:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564337280 00000100:00100000:1.0:1789672767.165362:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564337280 00000100:00100000:1.0:1789672767.165407:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672767.165417:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14429:x1876607564337280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.165642:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14429:x1876607564337280:12345-0@lo:502:llog_process_th.0 Request processed in 226us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672767.165650:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789672767.165845:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a219180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14429:1876607564337280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672767.165870:0:14429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672767.165875:0:14429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672767.165877:0:14429:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789672767.165881:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789672767.166041:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789672767.166057:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789672767.166079:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0983f expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.166097:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542f000/0x2247cb9491d09838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0983f expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672767.166105:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa6186e7800 from 1 10000000:01000000:1.0:1789672767.166107:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672767.166133:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.166145:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.166155:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672767.166170:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789672767.166171:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564337152:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789672767.166202:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607564337152 offset 0 length 520: 4 00000100:00100000:1.0:1789672767.166207:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.166226:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.166239:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564337408 00000100:00100000:3.0:1789672767.166243:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564337408 00000100:00100000:3.0:1789672767.166275:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789672767.166283:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+9:14393:x1876607564337408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672767.166292:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672767.166305:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d098b6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.166325:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.166337:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.166346:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:3.0:1789672767.166382:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+10:14393:x1876607564337408:12345-0@lo:101:mount.lustre.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.166388:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672767.166408:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789672767.166421:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.166430:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672767.167009:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337536:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789672767.167046:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.167067:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672767.167331:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564337536 00000100:00100000:2.0:1789672767.167337:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564337536 00000100:00100000:2.0:1789672767.167364:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672767.167371:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+10:14393:x1876607564337536:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789672767.167386:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789672767.167393:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789672767.167486:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+10:14393:x1876607564337536:12345-0@lo:256:mount.lustre.0 Request processed in 116us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672767.167493:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789672767.167632:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337536:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789672767.168297:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789672767.168315:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168334:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672767.168341:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6186e7800 from 1 10000000:01000000:3.0:1789672767.168343:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672767.168375:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168382:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168390:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672767.168407:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789672767.168445:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672767.168553:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.168581:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564337664 00000100:00100000:3.0:1789672767.168586:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564337664 00000100:00100000:3.0:1789672767.168617:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672767.168624:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+10:14393:x1876607564337664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672767.168634:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672767.168647:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d098c4 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168666:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168686:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168694:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67de00, rc 0) 00000100:00100000:3.0:1789672767.168725:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564337664:12345-0@lo:101:mount.lustre.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.168731:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672767.168770:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672767.168782:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.168811:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672767.168854:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672767.168875:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672767.168886:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6106c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.168897:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564337792 00000100:00100000:3.0:1789672767.168900:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564337792 00000100:00100000:3.0:1789672767.168916:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789672767.168921:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564337792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672767.169589:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564337792:12345-0@lo:501:mount.lustre.0 Request processed in 665us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.169596:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672767.169732:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789672767.169765:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789672767.169819:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.169851:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.169982:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564337920 00000100:00100000:3.0:1789672767.169987:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564337920 00000100:00100000:3.0:1789672767.170036:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789672767.170042:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564337920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789672767.170308:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564337920:12345-0@lo:503:mount.lustre.0 Request processed in 265us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.170314:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672767.170388:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564337920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789672767.170809:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14437:1876607564338048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.170843:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.170868:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.170934:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338048 00000100:00100000:3.0:1789672767.170938:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338048 00000100:00100000:3.0:1789672767.170965:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789672767.170971:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14437:x1876607564338048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672767.171192:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14437:x1876607564338048:12345-0@lo:502:llog_process_th.0 Request processed in 219us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.171198:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789672767.171390:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14437:1876607564338048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672767.171411:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672767.171420:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672767.171423:0:14437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789672767.171430:0:14437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa6186e7800 00000020:00000080:1.0:1789672767.171432:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789672767.171440:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672767.171442:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672767.171443:0:14437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789672767.171445:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672767.171447:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672767.171449:0:14437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789672767.171452:0:14437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa6186e7800 00000020:00000080:1.0:1789672767.171454:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789672767.171597:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672767.171601:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672767.171602:0:14437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789672767.171604:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672767.171606:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672767.171608:0:14437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672767.171611:0:14437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa6186e7800 00000020:00000080:1.0:1789672767.171618:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672767.172308:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14437:1876607564338176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.172355:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.173305:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672767.175350:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338176 00000100:00100000:0.0:1789672767.175362:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338176 00000100:00100000:0.0:1789672767.175423:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672767.175432:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14437:x1876607564338176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672767.175676:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14437:x1876607564338176:12345-0@lo:502:llog_process_th.0 Request processed in 245us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.175684:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672767.176080:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14437:1876607564338176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672767.176114:0:14437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672767.176122:0:14437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672767.176124:0:14437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789672767.176128:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789672767.176370:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789672767.176387:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672767.176409:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176420:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672767.176463:0:14393:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789672767.176466:0:14393:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa6186e7800 10000000:01000000:0.0:1789672767.176469:0:14393:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa6186e7800 10000000:01000000:0.0:1789672767.176484:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789672767.176490:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa6186e7800 from 1 10000000:01000000:0.0:1789672767.176492:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789672767.176522:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176531:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176539:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672767.176558:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564338304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789672767.176597:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672767.176625:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602ea3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672767.176640:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338304 00000100:00100000:0.0:1789672767.176645:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338304 00000100:00100000:0.0:1789672767.176671:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789672767.176677:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564338304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789672767.176696:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672767.176708:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa61d910800/0x2247cb9491d098d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d098d2 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176729:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa61d910800/0x2247cb9491d098d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d098d2 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176739:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa61d910800/0x2247cb9491d098d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098d2 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176747:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910800, rc 0) 00000100:00100000:0.0:1789672767.176776:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14393:x1876607564338304:12345-0@lo:101:mount.lustre.0 Request processed in 99us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.176782:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789672767.176849:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564338304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789672767.176862:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.176870:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d098d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672767.176908:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564338432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672767.176932:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672767.176944:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602ea3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672767.177107:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338432 00000100:00100000:1.0:1789672767.177112:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338432 00000100:00100000:1.0:1789672767.177146:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789672767.177153:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14393:x1876607564338432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789672767.177467:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14393:x1876607564338432:12345-0@lo:501:mount.lustre.0 Request processed in 313us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.177583:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564338432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672767.177614:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564338560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789672767.177653:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672767.177686:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa602ea3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672767.177701:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338560 00000100:00100000:0.0:1789672767.177706:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338560 00000100:00100000:0.0:1789672767.177731:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789672767.177739:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+13:14393:x1876607564338560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789672767.178279:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789672767.182313:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14393:x1876607564338560:12345-0@lo:503:mount.lustre.0 Request processed in 4566us (4651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.182328:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672767.185325:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564338560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789672767.185649:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14442:1876607564338688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.185722:0:14442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.185761:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338688 00000100:00100000:1.0:1789672767.185768:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338688 00000100:00100000:1.0:1789672767.185830:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672767.185839:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14442:x1876607564338688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.186156:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14442:x1876607564338688:12345-0@lo:502:llog_process_th.0 Request processed in 317us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672767.186165:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672767.186318:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672767.186334:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14442:1876607564338688:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789672767.186397:0:14442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789672767.186413:0:14442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fa62f3c0000) 00000020:00000080:1.0:1789672767.186433:0:14442:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789672767.187373:0:14442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa6186e7800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789672767.187380:0:14442:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa6186e7800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789672767.187384:0:14442:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa6186e7800 4 00010000:00080000:1.0:1789672767.187426:0:14442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa604f2c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.139@tcp at head 00010000:00010000:1.0:1789672767.191635:0:14442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789672767.193226:0:14442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789672767.193264:0:14442:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789672767.193279:0:14442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2247cb9491d098e7 00000100:00080000:1.0:1789672767.193291:0:14442:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672767.193302:0:14442:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fa604f2c000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672767.193339:0:14442:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63f782d80 x1876607564338816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672767.193369:0:14442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789672767.193624:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564338816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789672767.193691:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.194308:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338816 00000100:00100000:1.0:1789672767.194316:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338816 00000100:00100000:1.0:1789672767.194358:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672767.194364:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564338816:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789672767.194430:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564338816:12345-0@lo:38:llog_process_th.0 Request processed in 64us (737us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789672767.194436:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672767.194597:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672767.194605:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa604f2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789672767.194610:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789672767.194619:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564338816:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789672767.194721:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14442:1876607564338944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.194766:0:14442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.194812:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672767.195895:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564338944 00000100:00100000:1.0:1789672767.195903:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564338944 00000100:00100000:1.0:1789672767.195942:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672767.195950:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14442:x1876607564338944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672767.196307:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14442:x1876607564338944:12345-0@lo:502:llog_process_th.0 Request processed in 357us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672767.196315:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672767.196393:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14442:1876607564338944:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789672767.196422:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789672767.196558:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789672767.196585:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789672767.196599:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.196610:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa61d910a00/0x2247cb9491d098d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789672767.196652:0:14393:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789672767.196654:0:14393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789672767.196656:0:14393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672767.196657:0:14393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672767.196659:0:14393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672767.196660:0:14393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672767.196662:0:14393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672767.196663:0:14393:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789672767.196668:0:14393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672767.196669:0:14393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789672767.196672:0:14393:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789672767.196674:0:14393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789672767.196675:0:14393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789672767.196676:0:14393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672767.196677:0:14393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672767.196678:0:14393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672767.196679:0:14393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672767.196680:0:14393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672767.196681:0:14393:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789672767.196682:0:14393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672767.196683:0:14393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789672767.196700:0:14393:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789672767.196711:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564339072:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789672767.196741:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.196765:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672767.196924:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339072 00000100:00100000:1.0:1789672767.196930:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339072 00000100:00100000:1.0:1789672767.196957:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672767.196963:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14393:x1876607564339072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789672767.196995:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789672767.197023:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789672767.258008:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789672767.258064:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789672767.258728:0:14427:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789672767.258734:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789672767.258756:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.258777:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.258812:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.258870:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.258884:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 12 pid: 14406 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672767.258899:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1876607564339200:0@lo:104: 00000100:00100000:1.0:1789672767.258965:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.259025:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6103229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.259105:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339200 00000100:00100000:3.0:1789672767.259113:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339200 00000100:00100000:3.0:1789672767.259154:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672767.259162:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14427:x1876607564339200:12345-0@lo:104: 00010000:00010000:3.0:1789672767.259184:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.259241:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672767.259247:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14427:x1876607564339200:12345-0@lo:104: Request processed in 86us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.259253:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672767.259378:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1876607564339200:0@lo:104: 00010000:00010000:1.0:1789672767.259396:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.259628:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672767.259636:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.259643:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:0.0:1789672767.259647:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.259655:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672767.259661:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672767.259666:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672767.259701:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.259707:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672767.259736:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.259754:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63542e600/0x2247cb9491d098b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098bd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.259770:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672767.259771:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672767.259773:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672767.259825:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672767.259836:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564339328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672767.259871:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672767.259929:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339328 00000100:00100000:0.0:1789672767.259934:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339328 00010000:00010000:0.0:1789672767.259954:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 13 pid: 14406 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672767.259977:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672767.259984:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+13:3299:x1876607564339328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672767.259994:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672767.260011:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 13 pid: 14406 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260020:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 13 pid: 14406 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260032:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67d800/0x2247cb9491d098bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d098b6 expref: 13 pid: 14406 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260043:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260059:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789672767.260070:0:14396:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001337125s 00010000:00010000:0.0:1789672767.260075:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260080:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260086:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260092:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260098:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672767.260102:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260108:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260121:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260129:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672767.260158:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3299:x1876607564339328:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.260164:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672767.260340:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564339328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672767.260357:0:14427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260364:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672767.260370:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542f400/0x2247cb9491d098ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672767.275599:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14393:x1876607564339072:12345-0@lo:253:mount.lustre.0 Request processed in 78628us (78849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.275614:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672767.275721:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14393:1876607564339072:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789672767.275734:0:14393:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789672767.275737:0:14393:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789672767.275739:0:14393:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789672767.275741:0:14393:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672767.275742:0:14393:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672767.275743:0:14393:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672767.275744:0:14393:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672767.275745:0:14393:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672767.275747:0:14393:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789672767.275748:0:14393:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672767.275750:0:14393:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789672767.275764:0:14393:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789672767.282865:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672767.283057:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789672767.283639:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672767.283847:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789672767.284133:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672767.285063:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789672767.290699:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672767.290913:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789672767.291164:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672767.291668:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789672767.292770:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789672767.292968:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789672767.332972:0:14393:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789672767.333385:0:14393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789672767.333819:0:14450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789672767.333883:0:14450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789672767.337428:0:14393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789672767.338779:0:14393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789672767.339225:0:14393:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789672767.339236:0:14393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789672767.344065:0:14450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789672767.344142:0:14450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789672767.344147:0:14450:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789672767.344710:0:14393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789672767.345588:0:14449:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789672767.345594:0:14449:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1789672767.349645:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789672767.351843:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789672767.351917:0:14393:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789672767.356667:0:14393:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789672767.364097:0:14393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789672767.435672:0:14393:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789672767.435732:0:14393:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb88781953988 00100000:10000000:3.0:1789672767.435741:0:14393:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789672767.436670:0:14393:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789672767.436685:0:14393:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789672767.436697:0:14393:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789672767.436723:0:14393:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789672767.795076:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789672767.922923:0:14408:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789672767.922942:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa6186e7800 from 6 10000000:01000000:1.0:1789672767.922947:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672767.923009:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.923021:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.923031:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672767.923059:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564339456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672767.923131:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.923196:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6103226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672767.923515:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339456 00000100:00100000:3.0:1789672767.923524:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339456 00000100:00100000:3.0:1789672767.923581:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789672767.923593:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14408:x1876607564339456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672767.923607:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672767.923622:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d098f5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.923647:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.923660:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.923669:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c600, rc 0) 00000100:00100000:3.0:1789672767.923725:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564339456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672767.923731:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789672767.923884:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564339456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672767.923900:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672767.924000:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672767.924056:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564339584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789672767.924088:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672767.924123:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6103226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672767.924190:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339584 00000100:00100000:0.0:1789672767.924196:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339584 00000100:00100000:0.0:1789672767.924230:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672767.924238:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564339584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789672767.924252:0:14405:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789672767.924269:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789672767.924272:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789672767.924363:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564339584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672767.924372:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672767.924914:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564339584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789672767.925029:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789672767.925037:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672767.925055:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672768.244477:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789672768.819415:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672769.268109:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789672769.844237:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672770.872119:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672771.621197:0:14692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789672771.893368:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789672772.536837:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789672772.536843:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789672772.536846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789672772.536849:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789672772.536851:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789672772.536855:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789672772.536858:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fa604f2c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789672772.536875:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fa604f2c000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:3.0:1789672772.536897:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa62f0f4380 x1876607564339840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672772.536929:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564339840:0@lo:38:kworker.0 00000100:00100000:3.0:1789672772.537007:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672772.537209:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672772.537219:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564339712:0@lo:400:kworker.0 00000100:00100000:1.0:1789672772.537254:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672772.537294:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339840 00000100:00100000:1.0:1789672772.537301:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339840 00000100:00100000:1.0:1789672772.537332:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672772.537339:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1876607564339840:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789672772.537364:0:14413:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000100:00100000:3.0:1789672772.537616:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339712 00000100:00100000:3.0:1789672772.537621:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339712 00000100:00100000:3.0:1789672772.537652:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672772.537659:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3302:x1876607564339712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672772.537707:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3302:x1876607564339712:12345-0@lo:400:kworker.0 Request processed in 49us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.537714:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672772.537777:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564339712:0@lo:400:kworker.0 00000020:00000080:1.0:1789672772.538205:0:14413:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2247cb9491d09903 00000004:00100000:1.0:1789672772.538221:0:14413:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789672772.538354:0:14413:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb83800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672772.538408:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876607564339840:12345-0@lo:38:kworker.0 Request processed in 1068us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672772.538415:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789672772.538577:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa62f0f4380 x1876607564339840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789672772.538592:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789672772.538599:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789672772.538603:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789672772.538605:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa604f2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789672772.538611:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876607564339840:0@lo:38:kworker.0 00010000:00010000:0.0:1789672772.917864:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672773.944204:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789672774.375692:0:14843:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca12f3ba0 20000000:00000080:1.0:1789672774.375709:0:14843:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa62f149800 uarg=0000000000000000 20000000:01000000:1.0:1789672774.375742:0:14843:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789672774.375749:0:14843:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789672774.375754:0:14843:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789672774.376679:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789672774.376959:0:14843:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789672774.388667:0:14843:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789672774.389292:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.389315:0:14843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.389324:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.389375:0:14843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 11 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.389389:0:14843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 11 pid: 14406 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672774.389406:0:14843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14843:1876607564339968:0@lo:104: 00000100:00100000:0.0:1789672774.389481:0:14843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.389539:0:14843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672774.389622:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564339968 00000100:00100000:3.0:1789672774.389631:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564339968 00000100:00100000:3.0:1789672774.389684:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672774.389694:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14843:x1876607564339968:12345-0@lo:104: 00010000:00010000:3.0:1789672774.389708:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.389765:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672774.389771:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14843:x1876607564339968:12345-0@lo:104: Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.389778:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789672774.389845:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672774.389851:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.389858:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67dc00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672774.389861:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.389884:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672774.389891:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672774.389897:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672774.389924:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.389942:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672774.389961:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.389968:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63f67dc00/0x2247cb9491d098c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098cb expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.389984:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672774.389986:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672774.389988:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672774.390006:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564340096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672774.390034:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672774.390070:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564340096 00000100:00100000:3.0:1789672774.390075:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564340096 00010000:00010000:3.0:1789672774.390093:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 12 pid: 14406 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672774.390125:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672774.390132:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3302:x1876607564340096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672774.390150:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672774.390155:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 12 pid: 14406 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390174:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 12 pid: 14406 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390189:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390196:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390209:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390217:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390224:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390230:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390235:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672774.390239:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390245:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390264:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672774.390274:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672774.390304:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3302:x1876607564340096:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.390310:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672774.390346:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564340096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672774.390989:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67de00/0x2247cb9491d098cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d098c4 expref: 11 pid: 14406 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672774.391001:0:14843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14843:1876607564339968:0@lo:104: 00010000:00010000:0.0:1789672774.391020:0:14843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.391029:0:14843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.391035:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672774.391049:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa61d911600/0x2247cb9491d0990a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672774.964209:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672775.988647:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789672776.179516:0:14408:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672776.179526:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6186e7800 from 10 10000000:01000000:0.0:1789672776.179531:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672776.179580:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672776.179592:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672776.179604:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672776.179631:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564340224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672776.179695:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672776.179762:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672776.181621:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564340224 00000100:00100000:2.0:1789672776.181633:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564340224 00000100:00100000:2.0:1789672776.181691:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672776.181701:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+11:14408:x1876607564340224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672776.181719:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672776.181739:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09911 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672776.181767:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09911 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672776.181815:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09911 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672776.181825:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929e200, rc 0) 00000100:00100000:2.0:1789672776.181904:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564340224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672776.181922:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672776.181937:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564340224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672776.181957:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672776.181967:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672776.182036:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564340352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672776.182068:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672776.182100:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564340352 00000100:00100000:1.0:1789672776.182104:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564340352 00000100:00100000:0.0:1789672776.182115:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672776.182129:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672776.182136:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564340352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672776.182379:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564340352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672776.182386:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672776.184672:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564340352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672776.184725:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564340480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672776.184800:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672776.184831:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672776.186209:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564340480 00000100:00100000:1.0:1789672776.186222:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564340480 00000100:00100000:1.0:1789672776.186285:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672776.186295:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564340480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672776.186524:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:14408:x1876607564340480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672776.186532:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672776.186547:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564340480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789672776.187729:0:14914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789672776.193256:0:14408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789672776.193309:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672776.193322:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672776.193336:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672777.020429:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789672777.651112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789672777.651119:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789672777.651122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789672777.651125:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789672777.651278:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564340736:0@lo:400:kworker.0 00000100:00100000:0.0:1789672777.651278:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564340608:0@lo:400:kworker.0 00000100:00100000:2.0:1789672777.651538:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672767/real 1789672767] req@ffff9fa63a21b800 x1876607564337152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672777.655196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672777.655290:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564340736 00000100:00100000:3.0:1789672777.655299:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564340736 00000100:00100000:3.0:1789672777.657778:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672777.657824:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672777.657939:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564340736:12345-0@lo:400:kworker.0 Request processed in 132us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672777.657947:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789672777.658036:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa6352cea00 x1876607564340736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672777.658051:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564340736:0@lo:400:kworker.0 00000100:00100000:0.0:1789672777.659286:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672777.659374:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564340608 00000100:00100000:0.0:1789672777.659383:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564340608 00000100:00100000:0.0:1789672777.659434:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672777.659445:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3299:x1876607564340608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672777.659495:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:3299:x1876607564340608:12345-0@lo:400:kworker.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672777.659501:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672777.659546:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564340608:0@lo:400:kworker.0 00000100:00100000:2.0:1789672777.663532:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa63a21b800 x1876607564337152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672777.663550:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672767/real 1789672767] req@ffff9fa63a21ad80 x1876607564337024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672777.663563:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa63a21ad80 x1876607564337024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789672777.663580:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672777.663598:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789672777.663602:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564337152:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789672777.663607:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6031e7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672777.663612:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789672777.663615:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564337024:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789672777.663854:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789672777.663860:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789672777.663863:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fa6031e7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789672777.663869:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1789672777.663907:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789672777.663919:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa6031e7800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672777.663949:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63f781c00 x1876607564340864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672777.663968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789672777.663971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789672777.663973:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789672777.663977:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1789672777.663980:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789672777.663985:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa6209e6000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672777.663997:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63f780700 x1876607564340992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789672777.664086:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564340864:0@lo:8:kworker.0 00000400:00000100:2.0:1789672777.664153:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607564340864 offset 0 length 520: 4 00000100:00100000:2.0:1789672777.664188:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564340992:0@lo:8:kworker.0 00000400:00000100:2.0:1789672777.664206:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607564340992 offset 0 length 520: 4 00010000:00010000:0.0:1789672778.035038:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672779.060650:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789672779.513875:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789672779.525850:0:15092:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789672779.525854:0:15092:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789672779.525982:0:15092:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa63f8cd800 00000020:01000004:2.0:1789672779.525998:0:15092:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789672779.526012:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789672779.526027:0:15092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fa6103d8000) 00000020:00000080:2.0:1789672779.526044:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789672779.541401:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789672779.541596:0:15092:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789672779.542719:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789672779.543011:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789672779.543314:0:15092:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789672779.543576:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 525: rc = 0 00100000:10000000:2.0:1789672779.543714:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 525: rc = 0 00100000:10000000:2.0:1789672779.543866:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:2.0:1789672779.544406:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 897: rc = 0 00100000:10000000:2.0:1789672779.544693:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 897: rc = 0 00100000:10000000:2.0:1789672779.545141:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 897: rc = 0 00100000:10000000:2.0:1789672779.545438:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 897: rc = 0 00100000:10000000:2.0:1789672779.545727:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 897: rc = 0 00100000:10000000:2.0:1789672779.545982:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 897: rc = 0 00000020:00000080:2.0:1789672779.546563:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789672779.546573:0:15092:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789672779.546584:0:15092:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2247cb9491d09926 00000020:01000004:2.0:1789672779.546592:0:15092:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789672779.546679:0:15092:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789672779.546684:0:15092:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789672779.546690:0:15092:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789672779.546694:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789672779.546707:0:15092:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fa6103dcd40) 00000020:00000080:2.0:1789672779.546717:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789672779.547951:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672779.548124:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789672779.548131:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789672779.548962:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789672779.548970:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789672779.549277:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789672779.549283:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789672779.551048:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672779.551232:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789672779.551238:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789672779.551909:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789672779.551916:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789672779.579355:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672779.579587:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789672779.579595:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789672779.581458:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789672779.581471:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789672779.582750:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789672779.582762:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789672779.586898:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672779.587353:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789672779.587366:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789672779.588406:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789672779.588415:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789672779.630686:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789672779.631145:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789672779.631152:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789672779.632981:0:15092:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789672779.632992:0:15092:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789672779.633721:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789672779.633748:0:15092:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789672779.633755:0:15092:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789672779.646965:0:15092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789672779.647008:0:15092:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.139@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789672779.647017:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789672779.647019:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672779.647020:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672779.647021:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672779.647022:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672779.647024:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672779.647025:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672779.647026:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672779.647028:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672779.647031:0:15092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789672779.647033:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672779.647035:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672779.647036:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672779.647037:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672779.647038:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672779.647039:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672779.647039:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672779.647041:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672779.647042:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672779.647076:0:15092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789672779.647097:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789672779.647165:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.647329:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672779.647368:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341120 00000100:00100000:3.0:1789672779.647376:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341120 00000100:00100000:3.0:1789672779.647461:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789672779.647470:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:15092:x1876607564341120:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789672779.647499:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789672779.647502:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789672779.647506:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789672779.654687:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:15092:x1876607564341120:12345-0@lo:253:mount.lustre.0 Request processed in 7209us (7512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672779.654703:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789672779.654926:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341120:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789672779.654960:0:15092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789672779.654963:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789672779.654965:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789672779.654966:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672779.654968:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672779.654969:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672779.654970:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672779.654971:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672779.654973:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672779.654974:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789672779.654996:0:15092:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa63f8cd800 from lustre-OST0000 10000000:01000000:0.0:1789672779.655024:0:15092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789672779.655028:0:15092:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789672779.655034:0:15092:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa611cab380 local copy 00010000:00010000:0.0:1789672779.655044:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672779.655427:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672779.655469:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672779.655558:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672779.655685:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341248 00000100:00100000:1.0:1789672779.655692:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341248 00000100:00100000:1.0:1789672779.655775:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789672779.655803:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:15092:x1876607564341248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789672779.656389:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:15092:x1876607564341248:12345-0@lo:501:mount.lustre.0 Request processed in 603us (916us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789672779.656398:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672779.656491:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341248:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789672779.656509:0:15092:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789672779.656937:0:15092:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789672779.656947:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.656957:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672779.656984:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa63f8cd800 10000000:01000000:2.0:1789672779.656996:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789672779.657001:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fa611cab380 10000000:01000000:2.0:1789672779.657003:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789672779.657006:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fa611cab380 from 1 10000000:01000000:2.0:1789672779.657010:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789672779.657042:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.657051:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.657136:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672779.657155:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789672779.657273:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.657364:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672779.657407:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341376 00000100:00100000:3.0:1789672779.657414:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341376 00000100:00100000:3.0:1789672779.657488:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789672779.657497:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+12:15092:x1876607564341376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672779.657508:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672779.657520:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0993b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09934 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.657541:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0993b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09934 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.657551:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67dc00/0x2247cb9491d0993b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09934 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.657560:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67dc00, rc 0) 00000100:00100000:3.0:1789672779.657601:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+13:15092:x1876607564341376:12345-0@lo:101:mount.lustre.0 Request processed in 105us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672779.657626:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789672779.657692:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672779.657707:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0993b expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.657715:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0993b expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672779.657732:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789672779.657747:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0993b expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.657754:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929f800/0x2247cb9491d09934 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0993b expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672779.657772:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789672779.657775:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789672779.657779:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789672779.657780:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789672779.657818:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.657824:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.657831:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672779.657842:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789672779.657865:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.658299:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.658327:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341504 00000100:00100000:0.0:1789672779.658333:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341504 00000100:00100000:1.0:1789672779.658377:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672779.658386:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+13:15092:x1876607564341504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789672779.658394:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672779.658403:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542fc00/0x2247cb9491d09949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09942 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.658432:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542fc00/0x2247cb9491d09949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09942 expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.658439:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542fc00/0x2247cb9491d09949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09942 expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.658446:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fc00, rc 0) 00000100:00100000:1.0:1789672779.658490:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341504:12345-0@lo:101:mount.lustre.0 Request processed in 105us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.658496:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789672779.658698:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672779.658713:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09949 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.658721:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09949 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672779.659584:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789672779.660859:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672779.661348:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789672779.661397:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789672779.661433:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789672779.661494:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789672779.661530:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789672779.661566:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789672779.661889:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789672779.661900:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789672779.661982:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672779.662042:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.662268:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672779.662430:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341632 00000100:00100000:3.0:1789672779.662439:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341632 00000100:00100000:3.0:1789672779.662524:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672779.662534:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672779.663020:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341632:12345-0@lo:501:mount.lustre.0 Request processed in 487us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672779.663028:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789672779.663267:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672779.663310:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672779.663353:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.663521:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.663593:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341760 00000100:00100000:0.0:1789672779.663598:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341760 00000100:00100000:0.0:1789672779.663636:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789672779.663642:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789672779.663981:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341760:12345-0@lo:503:mount.lustre.0 Request processed in 338us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672779.663989:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672779.664235:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341760:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789672779.664780:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789672779.664876:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789672779.664934:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.664962:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.665205:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564341888 00000100:00100000:0.0:1789672779.665211:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564341888 00000100:00100000:0.0:1789672779.665244:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672779.665251:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672779.665466:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564341888:12345-0@lo:502:mount.lustre.0 Request processed in 214us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672779.665473:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672779.665615:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564341888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789672779.665875:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789672779.665936:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789672779.665971:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789672779.666019:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789672779.666054:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789672779.666314:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789672779.666366:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789672779.666397:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789672779.666428:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789672779.666485:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789672779.666519:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789672779.666592:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789672779.666782:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789672779.666868:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.666910:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa608be2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.666979:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342016 00000100:00100000:0.0:1789672779.666986:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342016 00000100:00100000:0.0:1789672779.667026:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672779.667034:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564342016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672779.667377:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564342016:12345-0@lo:502:mount.lustre.0 Request processed in 343us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672779.667385:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789672779.667479:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789672779.667556:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789672779.667567:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789672779.669003:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789672779.669013:0:15106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789672779.669021:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.669023:0:15106:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789672779.669030:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672779.669051:0:15106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fa63a6e8000) 00000020:00000080:2.0:1789672779.669155:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789672779.669164:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789672779.669245:0:15106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa63f8cd800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789672779.669253:0:15106:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789672779.669260:0:15106:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2247cb9491d09957 00010000:00010000:2.0:1789672779.674018:0:15106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789672779.674813:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789672779.677095:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789672779.678733:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789672779.678745:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672779.678751:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672779.678753:0:15106:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789672779.678761:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789672779.678764:0:15106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789672779.678765:0:15106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789672779.678766:0:15106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789672779.678768:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789672779.678770:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672779.678771:0:15106:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789672779.678774:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672779.678776:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672779.678778:0:15106:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672779.678781:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672779.678805:0:15106:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789672779.678809:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672779.678812:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672779.678813:0:15106:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789672779.678816:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672779.678819:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672779.678827:0:15106:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789672779.678832:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789672779.678901:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672779.678905:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672779.678907:0:15106:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789672779.678910:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789672779.680745:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789672779.680782:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789672779.680827:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09949 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.680841:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929fc00/0x2247cb9491d09942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09949 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672779.680851:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa63f8cd800 from 1 10000000:01000000:3.0:1789672779.680854:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672779.680907:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.680917:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.680928:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672779.680953:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789672779.681031:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672779.681161:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672779.681842:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342144 00000100:00100000:1.0:1789672779.681851:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342144 00000100:00100000:1.0:1789672779.681915:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789672779.681924:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+14:15092:x1876607564342144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789672779.681939:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672779.681953:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0995e expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.681976:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0995e expref: 15 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.681987:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0995e expref: 15 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.681995:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f600, rc 0) 00000100:00100000:1.0:1789672779.682045:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342144:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.682051:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672779.682182:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672779.682211:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.682219:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672779.682875:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789672779.684498:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672779.685931:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789672779.686001:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789672779.686707:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789672779.686720:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789672779.686854:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672779.686933:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672779.686979:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672779.687643:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342272 00000100:00100000:1.0:1789672779.687653:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342272 00000100:00100000:1.0:1789672779.687704:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789672779.687713:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789672779.687981:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342272:12345-0@lo:501:mount.lustre.0 Request processed in 268us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.687997:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789672779.688484:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672779.688529:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789672779.688579:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.688703:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342400 00000100:00100000:2.0:1789672779.688710:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342400 00000100:00100000:2.0:1789672779.688740:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672779.688747:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672779.688939:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342400:12345-0@lo:503:mount.lustre.0 Request processed in 192us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672779.688956:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789672779.690308:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672779.690338:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789672779.693895:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789672779.693988:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672779.694321:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672779.695000:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa60832c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.702208:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342528 00000100:00100000:0.0:1789672779.702224:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342528 00000100:00100000:1.0:1789672779.702443:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789672779.702455:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789672779.702769:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342528:12345-0@lo:502:mount.lustre.0 Request processed in 315us (8581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.702778:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672779.702938:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789672779.703248:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789672779.703304:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789672779.703353:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789672779.703393:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789672779.703427:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789672779.703472:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789672779.703502:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789672779.703528:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789672779.703563:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789672779.703606:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.703644:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672779.703921:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342656 00000100:00100000:1.0:1789672779.703928:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342656 00000100:00100000:1.0:1789672779.703959:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789672779.703965:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789672779.704140:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342656:12345-0@lo:502:mount.lustre.0 Request processed in 173us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.704147:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672779.704332:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789672779.704423:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789672779.704433:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789672779.706283:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672779.706294:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.706297:0:15110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789672779.706303:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa63f8cd800 00000020:00000080:2.0:1789672779.706305:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789672779.706312:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672779.706314:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.706316:0:15110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789672779.706319:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672779.706321:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.706322:0:15110:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789672779.706325:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa63f8cd800 00000020:00000080:2.0:1789672779.706327:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789672779.712870:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672779.712898:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.712901:0:15110:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789672779.712905:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672779.712909:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.712911:0:15110:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789672779.712917:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa63f8cd800 00000020:00000080:2.0:1789672779.712919:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789672779.719255:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672779.719268:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672779.719270:0:15110:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789672779.719275:0:15110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789672779.719924:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789672779.719953:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672779.719977:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.719989:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672779.720042:0:15092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789672779.720046:0:15092:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa63f8cd800 10000000:01000000:0.0:1789672779.720049:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa63f8cd800 10000000:01000000:0.0:1789672779.720053:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789672779.720234:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa63f8cd800 from 1 10000000:01000000:0.0:1789672779.720238:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789672779.720277:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.720292:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.720305:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672779.720328:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789672779.720415:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672779.720457:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.724213:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342784 00000100:00100000:0.0:1789672779.724228:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342784 00000100:00100000:0.0:1789672779.724285:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789672779.724295:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564342784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789672779.724314:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672779.724333:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa61d911200/0x2247cb9491d09973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d0996c expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.724871:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa61d911200/0x2247cb9491d09973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d0996c expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.724898:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa61d911200/0x2247cb9491d09973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0996c expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.724909:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911200, rc 0) 00000100:00100000:0.0:1789672779.724985:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564342784:12345-0@lo:101:mount.lustre.0 Request processed in 691us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672779.724993:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789672779.725084:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789672779.725104:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09973 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.725115:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09973 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672779.727140:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789672779.731014:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672779.740504:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789672779.740741:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789672779.740834:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789672779.740923:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789672779.740968:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789672779.741017:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789672779.741133:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789672779.741175:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789672779.741291:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789672779.741325:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789672779.741491:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789672779.741555:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789672779.741585:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789672779.741688:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789672779.741740:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789672779.741775:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789672779.743478:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789672779.743565:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789672779.744723:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789672779.744816:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789672779.744895:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789672779.744936:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789672779.744972:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789672779.745036:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789672779.746281:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789672779.746343:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789672779.746411:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789672779.746469:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789672779.746556:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789672779.746565:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789672779.754746:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672779.754833:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672779.754898:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564342912 00000100:00100000:0.0:1789672779.754905:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564342912 00000100:00100000:0.0:1789672779.754956:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789672779.754965:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564342912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672779.758505:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564342912:12345-0@lo:501:mount.lustre.0 Request processed in 3531us (3663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672779.758519:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789672779.758591:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f560000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.760758:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564342912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789672779.760946:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789672779.761018:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672779.761255:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611cfb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672779.761590:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343040 00000100:00100000:2.0:1789672779.761599:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343040 00000100:00100000:2.0:1789672779.762335:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789672779.762355:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672779.762577:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343040:12345-0@lo:503:mount.lustre.0 Request processed in 233us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672779.762586:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789672779.762689:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343040:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789672779.763364:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672779.763439:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789672779.763494:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672779.776653:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa611cfb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672779.781733:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343168 00000100:00100000:0.0:1789672779.781749:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343168 00000100:00100000:0.0:1789672779.781850:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789672779.781860:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672779.785013:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343168:12345-0@lo:502:mount.lustre.0 Request processed in 3144us (21507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672779.785029:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789672779.791472:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789672779.792977:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789672779.793068:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789672779.793106:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789672779.793159:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789672779.793196:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789672779.793245:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789672779.793280:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789672779.793313:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789672779.794591:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789672779.796325:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789672779.796434:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789672779.796735:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789672779.796780:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789672779.797338:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789672779.797459:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789672779.797709:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789672779.797774:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789672779.798412:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789672779.798457:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789672779.798689:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789672779.798743:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789672779.798777:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789672779.799319:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789672779.799456:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789672779.799580:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789672779.799738:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789672779.800308:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789672779.800412:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789672779.800450:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789672779.800699:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789672779.800742:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789672779.800779:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789672779.801335:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789672779.801996:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789672779.802040:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789672779.802090:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789672779.802129:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789672779.802164:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789672779.802726:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789672779.802775:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789672779.803016:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789672779.803101:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.803150:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672779.803259:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343296 00000100:00100000:1.0:1789672779.803267:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343296 00000100:00100000:1.0:1789672779.803322:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672779.803332:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789672779.803593:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343296:12345-0@lo:502:mount.lustre.0 Request processed in 262us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.803613:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789672779.803962:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789672779.804048:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789672779.804059:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789672779.808464:0:15115:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789672779.808481:0:15115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fa611cacd40) 00000020:00000080:0.0:1789672779.808685:0:15115:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789672779.808771:0:15115:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa63f8cd800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789672779.808775:0:15115:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa63f8cd800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789672779.808778:0:15115:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa63f8cd800 3 00010000:00080000:0.0:1789672779.808837:0:15115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa611e78000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.139@tcp at head 00010000:00010000:0.0:1789672779.825762:0:15115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789672779.826534:0:15115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789672779.826571:0:15115:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789672779.826590:0:15115:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2247cb9491d09981 00000100:00080000:0.0:1789672779.826658:0:15115:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789672779.826670:0:15115:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa611e78000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:0.0:1789672779.826705:0:15115:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa6352cd880 x1876607564343424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789672779.826730:0:15115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789672779.826804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789672779.826809:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789672779.826812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789672779.826815:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789672779.826979:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564343552:0@lo:400:kworker.0 00000100:00100000:1.0:1789672779.827043:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672779.827108:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343552 00000100:00100000:1.0:1789672779.827115:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343552 00000100:00100000:1.0:1789672779.827156:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672779.827166:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564343552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672779.827548:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564343552:12345-0@lo:400:kworker.0 Request processed in 382us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.827556:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672779.828307:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1876607564343424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789672779.828348:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.828396:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343424 00000100:00100000:2.0:1789672779.828402:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343424 00000100:00100000:2.0:1789672779.828427:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672779.828432:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1876607564343424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789672779.828452:0:14413:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1789672779.828483:0:14413:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2247cb9491d09988 00000004:00100000:2.0:1789672779.828506:0:14413:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789672779.828533:0:14413:0:(import.c:65:import_set_state_nolock()) ffff9fa61db4f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672779.828568:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876607564343424:12345-0@lo:38:llog_process_th.0 Request processed in 135us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672779.828586:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789672779.828622:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa6352cd880 x1876607564343424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672779.828632:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789672779.828638:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789672779.828645:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789672779.828649:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789672779.828651:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa611e78000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789672779.828656:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1876607564343424:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789672779.830266:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa63f781f80 x1876607564343552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672779.830281:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564343552:0@lo:400:kworker.0 00000040:00080000:0.0:1789672779.830468:0:15115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789672779.830858:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789672779.830909:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672779.830926:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09973 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.830937:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa61d911800/0x2247cb9491d0996c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09973 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789672779.830996:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789672779.830998:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672779.831000:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672779.831001:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672779.831002:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672779.831004:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672779.831005:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672779.831007:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672779.831008:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789672779.831011:0:15092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789672779.831014:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672779.831015:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672779.831016:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672779.831017:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672779.831018:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672779.831019:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672779.831020:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672779.831020:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672779.831021:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789672779.831049:0:15092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789672779.831077:0:15092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789672779.831142:0:15092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.831167:0:15092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672779.833023:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343680 00000100:00100000:1.0:1789672779.833035:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343680 00000100:00100000:1.0:1789672779.833102:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789672779.833112:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15092:x1876607564343680:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789672779.833142:0:14404:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789672779.833158:0:14404:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789672779.893290:0:14404:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789672779.893311:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789672779.893334:0:14427:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789672779.893339:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789672779.893362:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.893383:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 16 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.893392:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.893451:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 16 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672779.893465:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 16 pid: 14404 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672779.893481:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1876607564343808:0@lo:104: 00000100:00100000:0.0:1789672779.894772:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672779.894839:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604f43900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672779.895084:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343808 00000100:00100000:2.0:1789672779.895093:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343808 00000100:00100000:2.0:1789672779.895187:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672779.895196:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14427:x1876607564343808:12345-0@lo:104: 00010000:00010000:2.0:1789672779.895213:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.895293:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672779.895299:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14427:x1876607564343808:12345-0@lo:104: Request processed in 105us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672779.895306:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789672779.895327:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672779.895334:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.895342:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e000 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:2.0:1789672779.895346:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.895355:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672779.895363:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672779.895370:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672779.895402:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.895408:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672779.895429:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.895436:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d098f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d098fc expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672779.895462:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672779.895464:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672779.895466:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672779.895488:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564343936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672779.895520:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672779.895587:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1876607564343808:0@lo:104: 00010000:00010000:2.0:1789672779.895608:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672779.895721:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564343936 00000100:00100000:3.0:1789672779.895727:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564343936 00010000:00010000:3.0:1789672779.895749:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 17 pid: 14404 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672779.895779:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672779.895816:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:3302:x1876607564343936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672779.895868:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672779.895875:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 17 pid: 14404 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895895:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 17 pid: 14404 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895918:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d098fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d098f5 expref: 17 pid: 14404 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895931:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895940:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672779.895953:0:14398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002614432s 00010000:00010000:3.0:1789672779.895957:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895964:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895971:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895985:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.895992:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672779.896204:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.896212:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.896232:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672779.896244:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672779.896297:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3302:x1876607564343936:12345-0@lo:103:ldlm_bl.0 Request processed in 512us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672779.896304:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789672779.896439:0:14427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.896455:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672779.896461:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa61d910e00/0x2247cb9491d0998f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672779.897693:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564343936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672779.928672:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:15092:x1876607564343680:12345-0@lo:253:mount.lustre.0 Request processed in 95551us (97518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.928689:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672779.936340:0:15092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15092:1876607564343680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789672779.936365:0:15092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789672779.936369:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672779.936370:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789672779.936372:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672779.936373:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672779.936374:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672779.936375:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672779.936376:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672779.936379:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672779.936380:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789672779.936395:0:15092:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789672779.945215:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672779.945384:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672779.945572:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672779.945678:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672779.945776:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672779.945963:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789672779.948126:0:15092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789672779.996631:0:15092:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789672779.996640:0:15092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789672779.996673:0:15092:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789672779.996737:0:15092:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789672779.996749:0:15092:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789672779.996777:0:15092:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789672780.086593:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672781.106953:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789672781.429234:0:14408:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789672781.429243:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa6186e7800 from 7 10000000:01000000:2.0:1789672781.429248:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789672781.429297:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672781.429310:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672781.429336:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672781.429365:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564344064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672781.429441:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672781.429501:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789672781.429599:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344064 00000100:00100000:1.0:1789672781.429608:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344064 00000100:00100000:1.0:1789672781.429666:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672781.429676:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+15:14408:x1876607564344064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672781.429689:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672781.429703:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09996 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672781.429727:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09996 expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672781.429738:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09996 expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672781.429747:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542e600, rc 0) 00000100:00100000:1.0:1789672781.429812:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:14408:x1876607564344064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672781.429818:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672781.429887:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564344064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672781.429901:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672781.429910:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672781.429958:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564344192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789672781.430002:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672781.430018:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672781.430030:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344192 00000100:00100000:1.0:1789672781.430034:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344192 00000100:00100000:1.0:1789672781.430068:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789672781.430075:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:14408:x1876607564344192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789672781.430088:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789672781.430103:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789672781.430106:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789672781.430180:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:14408:x1876607564344192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672781.430186:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789672781.430214:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564344192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789672781.430265:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789672781.430271:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672781.430280:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672782.131038:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672783.156558:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672784.186428:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672785.202977:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672785.332026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789672785.332032:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672785.332035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789672785.332037:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789672785.332091:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564344320:0@lo:400:kworker.0 00000100:00100000:2.0:1789672785.332163:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.332221:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672785.332227:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564344448:0@lo:400:kworker.0 00000100:00100000:2.0:1789672785.332253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.332293:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564344576:0@lo:400:kworker.0 00000100:00100000:2.0:1789672785.332316:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.332348:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344320 00000100:00100000:2.0:1789672785.332356:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344320 00000100:00100000:2.0:1789672785.332400:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789672785.332409:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3299:x1876607564344320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672785.333089:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3299:x1876607564344320:12345-0@lo:400:kworker.0 Request processed in 678us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.333111:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789672785.333150:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344448 00000100:00100000:2.0:1789672785.333155:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344448 00000100:00100000:2.0:1789672785.333183:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344576 00000100:00100000:2.0:1789672785.333186:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344576 00000100:00100000:2.0:1789672785.333213:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672785.333220:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564344448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672785.333268:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564344448:12345-0@lo:400:kworker.0 Request processed in 48us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.333275:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672785.333290:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672785.333297:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564344576:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789672785.333370:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672785.333708:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564344576:12345-0@lo:400:kworker.0 Request processed in 411us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.333715:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789672785.333752:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa63a218700 x1876607564344448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672785.333767:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564344448:0@lo:400:kworker.0 00000100:00100000:2.0:1789672785.333777:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564344320:0@lo:400:kworker.0 00010000:00080000:1.0:1789672785.340128:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa63a218e00 x1876607564344576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672785.340151:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564344576:0@lo:400:kworker.0 00010000:00010000:1.0:1789672786.230433:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672786.377539:0:15462:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789672787.263670:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672788.277040:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672789.300643:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672789.748325:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789672790.323819:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789672790.452800:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789672790.452807:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789672790.452811:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789672790.452814:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789672790.452862:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672790.452875:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564344832:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.452876:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564344704:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.453151:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672790.453873:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344704 00000100:00100000:0.0:1789672790.453940:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344704 00000100:00100000:0.0:1789672790.454047:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789672790.454057:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3301:x1876607564344704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672790.454128:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3301:x1876607564344704:12345-0@lo:400:kworker.0 Request processed in 73us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672790.454135:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789672790.454181:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564344704:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.454874:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.455030:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672790.455040:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564344960:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.455075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.455117:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344832 00000100:00100000:3.0:1789672790.455123:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344832 00000100:00100000:3.0:1789672790.455156:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564344960 00000100:00100000:3.0:1789672790.455159:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564344960 00000100:00100000:3.0:1789672790.455183:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672790.455190:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564344832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.455248:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564344832:12345-0@lo:400:kworker.0 Request processed in 58us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.458919:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672790.459028:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789672790.459045:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564344960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.459142:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564344960:12345-0@lo:400:kworker.0 Request processed in 105us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.459149:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789672790.459180:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789672790.460058:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa62f0f5500 x1876607564344960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672790.460076:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564344960:0@lo:400:kworker.0 00010000:00080000:1.0:1789672790.460090:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa62f0f4000 x1876607564344832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672790.460098:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564344832:0@lo:400:kworker.0 00010000:00010000:2.0:1789672791.347471:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672792.053382:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672777/real 1789672777] req@ffff9fa63f781c00 x1876607564340864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672792 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672792.053413:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa63f781c00 x1876607564340864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672792 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672792.053424:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672777/real 1789672777] req@ffff9fa63f780700 x1876607564340992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672792 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672792.053450:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa63f780700 x1876607564340992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789672792 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789672792.053472:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6031e7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789672792.053496:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789672792.053500:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564340864:0@lo:8:kworker.0 00000100:00080000:3.0:1789672792.053506:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789672792.053510:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789672792.053513:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564340992:0@lo:8:kworker.0 00000100:00080000:0.0:1789672792.053689:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789672792.053694:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789672792.053703:0:469:0:(import.c:65:import_set_state_nolock()) ffff9fa6031e7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789672792.053707:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1789672792.053712:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789672792.053722:0:469:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa6031e7800 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:0.0:1789672792.053743:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa6352cf100 x1876607564345216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789672792.053756:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789672792.053760:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789672792.053775:0:469:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789672792.053779:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1789672792.053782:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1789672792.053910:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564345088:0@lo:400:kworker.0 00000100:00100000:1.0:1789672792.053974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.054036:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345088 00000100:00100000:1.0:1789672792.054044:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345088 00000100:00100000:1.0:1789672792.054091:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789672792.054100:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3301:x1876607564345088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672792.054160:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3301:x1876607564345088:12345-0@lo:400:kworker.0 Request processed in 61us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672792.054168:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789672792.054213:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564345088:0@lo:400:kworker.0 00000100:00080000:0.0:1789672792.054308:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa6209e6000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:0.0:1789672792.054325:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa6352cf480 x1876607564345344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789672792.054372:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564345600:0@lo:400:kworker.0 00000100:00100000:0.0:1789672792.054406:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.054495:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564345472:0@lo:400:kworker.0 00000100:00100000:3.0:1789672792.054522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.054566:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345600 00000100:00100000:3.0:1789672792.054570:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345600 00000100:00100000:3.0:1789672792.054604:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345472 00000100:00100000:3.0:1789672792.054607:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345472 00000100:00100000:3.0:1789672792.054620:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672792.054626:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564345600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672792.054662:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876607564345600:12345-0@lo:400:kworker.0 Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.054668:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672792.054680:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672792.054685:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564345472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672792.054712:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564345472:12345-0@lo:400:kworker.0 Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.054717:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789672792.054739:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789672792.054776:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa6352cd500 x1876607564345600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672792.054879:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1876607564345600:0@lo:400:kworker.0 00010000:00080000:3.0:1789672792.054907:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa6352cce00 x1876607564345472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672792.054915:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564345472:0@lo:400:kworker.0 00000100:00100000:3.0:1789672792.054930:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564345216:0@lo:8:kworker.0 00000100:00100000:3.0:1789672792.054958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.054991:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564345344:0@lo:8:kworker.0 00000100:00100000:3.0:1789672792.055012:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672792.068131:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345216 00000100:00100000:0.0:1789672792.068148:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345216 00000100:00100000:0.0:1789672792.068200:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345344 00000100:00100000:0.0:1789672792.068204:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345344 00000100:00100000:0.0:1789672792.068222:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672792.068229:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3298:x1876607564345216:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789672792.068262:0:15094:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1789672792.068296:0:15094:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d099a4 00002000:00100000:0.0:1789672792.068314:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fa63fb91000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789672792.068326:0:15094:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789672792.068329:0:15094:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789672792.068658:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789672792.068683:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9fa63fb94800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672792.069985:0:15093:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672792.070020:0:15093:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789672792.070914:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876607564345216:12345-0@lo:8:kworker.0 Request processed in 2679us (15949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672792.070924:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672792.070953:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672792.070959:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3298:x1876607564345344:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789672792.070976:0:15094:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789672792.071022:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3298:x1876607564345344:12345-0@lo:8:kworker.0 Request processed in 62us (16009us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789672792.071026:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789672792.071071:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa6352cf100 x1876607564345216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672792.071082:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672792.071091:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789672792.071099:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789672792.071103:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789672792.071106:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6031e7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789672792.071132:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789672792.071137:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564345216:0@lo:8:kworker.0 00000100:00080000:0.0:1789672792.071150:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789672792.071154:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789672792.071156:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564345344:0@lo:8:kworker.0 00000100:00100000:1.0:1789672792.072282:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564345728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672792.072342:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.072678:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345728 00000100:00100000:3.0:1789672792.072686:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345728 00000100:00100000:3.0:1789672792.072734:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672792.072750:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876607564345728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672792.072824:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:0.0:1789672792.072906:0:14434:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789672792.072934:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1876607564345856:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789672792.072962:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672792.072982:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672792.072999:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345856 00000100:00100000:0.0:1789672792.073003:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345856 00000100:00100000:0.0:1789672792.073025:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672792.073032:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14434:x1876607564345856:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789672792.076990:0:14433:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789672792.077321:0:14433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460858534236ns, next at 0ns, rc = 0 00002000:00080000:0.0:1789672792.080742:0:15095:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789672792.080754:0:15095:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789672792.080758:0:15095:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1789672792.086706:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564345728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13946us (14352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.086722:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789672792.086779:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672792.086945:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa6352cf480 x1876607564345728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672792.086971:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564345728:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1789672792.096361:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.096373:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.096391:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.096396:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.096403:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.096423:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.096434:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.096441:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.096469:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.116145:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.116161:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.116174:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.116179:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.116191:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.116212:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.116221:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.116240:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.116242:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.116243:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.117194:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.117204:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.117217:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.117229:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.117236:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.117251:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.117259:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.117266:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.117289:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789672792.118206:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.118215:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118226:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.118229:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.118233:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118244:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118252:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118266:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118280:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789672792.118725:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.118732:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118740:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.118743:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.118747:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118756:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118773:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118780:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.118823:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789672792.122818:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.122834:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.122863:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.122868:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.123001:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.123021:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.123033:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.123041:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.123054:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789672792.123819:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.123827:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.123838:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.123841:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.123846:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.123857:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124247:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124257:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124267:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1789672792.124809:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.124815:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124824:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.124827:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.124832:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124843:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124852:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.124859:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.128842:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1789672792.129460:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.129470:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129487:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.129492:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.129497:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129513:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129522:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129530:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129539:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1789672792.129825:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789672792.129833:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129843:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.129853:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129865:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129890:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129898:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d099b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129915:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789672792.129919:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129927:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.129930:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129939:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129949:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129956:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d099b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129973:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789672792.129977:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129984:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.129987:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.129995:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130004:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130012:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d099c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130023:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789672792.130026:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130033:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.130036:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130054:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130064:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130071:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d099c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130084:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789672792.130088:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130095:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.130098:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130106:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130115:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130123:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d099ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130150:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672792.130154:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130162:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.130165:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130175:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130185:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130192:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d099d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130206:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.130209:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130216:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.130219:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130236:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130247:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130254:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d099dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.130267:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.130269:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.130271:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.130279:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.133511:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.133525:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.133543:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.133548:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.133554:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.133575:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.133660:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.133675:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.133706:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672792.134054:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672792.134062:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134072:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672792.134077:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134092:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134115:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134123:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179f89e2/0x2247cb9491d099e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134147:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672792.134151:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672792.134153:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.134504:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.134511:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.134521:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.134525:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.134529:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.134541:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.134550:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.134558:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.134661:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672792.134824:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672792.134830:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134839:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672792.134844:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134853:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134868:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134888:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052c21f52/0x2247cb9491d099ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.134902:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672792.134904:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672792.134905:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.135427:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.135434:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135449:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.135453:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.135458:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135469:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135478:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135486:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135504:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.135516:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.135521:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135528:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.135532:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135540:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135568:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.135576:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d099f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.139865:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.139871:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.140015:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.142164:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.142177:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142193:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.142198:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.142204:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142219:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142230:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142237:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142273:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.142286:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.142292:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142300:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642045400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.142304:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142313:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142331:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142339:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008476aac3/0x2247cb9491d099f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.142357:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.142359:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.142361:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.143145:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.143154:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143165:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.143174:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.143178:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143188:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143197:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143203:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143220:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.143231:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.143235:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143243:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.143247:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143255:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143267:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143287:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d099ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.143303:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.143305:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.143307:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.144508:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.144518:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.144531:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.144535:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.144540:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.144552:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.144561:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.144569:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.145442:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.145462:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.145475:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.145486:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.145492:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.145503:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.145521:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.145528:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f14531ab/0x2247cb9491d09a06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.145552:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.145555:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.145556:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.149425:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.149441:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149461:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.149465:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.149471:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149654:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149667:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149676:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149695:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.149710:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.149716:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149725:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.149729:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149739:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149757:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149778:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b519cfb/0x2247cb9491d09a0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.149838:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.149841:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.149843:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.150412:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.150418:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.150428:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.150431:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.150435:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.150446:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.150453:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.150460:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.150486:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672792.150623:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672792.150631:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.150640:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672792.150645:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.150654:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.150670:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.150678:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067e2ac39/0x2247cb9491d09a14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.150708:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.150711:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.150714:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.151248:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.151255:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.151274:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.151278:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.151283:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.151293:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.151302:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.151309:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.151333:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672792.151431:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672792.151437:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.151445:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672792.151450:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.151458:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.151472:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.151479:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09a1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.151495:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.151497:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.151499:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.152151:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.152159:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152170:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.152174:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.152178:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152189:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152208:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152215:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152231:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.152241:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.152245:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152252:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.152255:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152263:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152275:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152283:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.152298:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.152306:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.152308:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.154732:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.154747:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.154773:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.154778:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.154801:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.154817:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.154828:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.154836:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.154857:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672792.155155:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672792.155163:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.155173:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672792.155178:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.155188:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672792.155418:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.155424:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.155433:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.155437:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.155441:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.155460:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.155468:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.155476:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.155492:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.155502:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672792.155693:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.155703:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041de2519/0x2247cb9491d09a29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.156186:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.156189:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.156191:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.157730:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.157735:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.157737:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.157813:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.157827:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672792.157832:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.157851:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.157871:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.157878:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.157899:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.157901:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.157903:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.158113:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.158122:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.158134:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.158139:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.158145:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.158159:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.158182:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.158190:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.158205:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672792.158386:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672792.158392:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.158401:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672792.158405:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.158412:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.158423:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.158440:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09a37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.158460:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.158462:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.158465:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.159854:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.159864:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.160658:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.160668:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.160676:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.160694:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.160706:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.160714:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.160755:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1789672792.161067:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789672792.161114:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.161120:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.161129:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.161134:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.161144:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.161162:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.161170:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.161195:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.161197:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.161198:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.162750:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.162772:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162816:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.162821:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.162826:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162839:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162850:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162858:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162888:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672792.162902:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672792.162907:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162916:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672792.162920:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162929:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162957:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162964:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b40a7b34/0x2247cb9491d09a45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.162983:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.162985:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672792.162987:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.163463:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.163470:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.163478:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.163482:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.163486:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.163495:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.163503:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.163510:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.163535:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672792.163911:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672792.163919:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.163927:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672792.163931:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.163950:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.163963:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.163969:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6bf777/0x2247cb9491d09a4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.163984:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.163985:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.163986:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.166088:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.166101:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.166115:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.166120:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.166126:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.166140:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.166150:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.166158:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.166184:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672792.166362:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672792.166370:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.166391:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672792.166396:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.166406:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.166422:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.166429:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09a53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.166451:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.166454:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.166455:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.168114:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.168126:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168142:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.168153:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.168159:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168172:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168183:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168190:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168214:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672792.168457:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672792.168465:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.168473:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672792.168478:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.168486:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.168501:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.168508:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b620ef5/0x2247cb9491d09a5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.168525:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.168526:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.168528:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.168699:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.168706:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168715:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.168719:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.168722:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168734:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168742:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168756:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.168816:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672792.169024:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672792.169031:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.169038:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672792.169042:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.169061:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.169072:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.169079:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831b88c4/0x2247cb9491d09a61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.169096:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.169098:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672792.169100:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789672792.169252:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789672792.169258:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.169266:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789672792.169269:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672792.169273:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.169283:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.169292:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.169299:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.169321:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672792.169407:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672792.169415:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.169424:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672792.169428:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.169436:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.169456:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.169464:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8dc40bd/0x2247cb9491d09a68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.169484:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.169486:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672792.169489:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789672792.169520:0:15095:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789672792.169630:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14434:x1876607564345856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96593us (96661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672792.169647:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672792.169848:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1876607564345856:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789672792.169865:0:14434:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789672792.169913:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1876607564345984:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789672792.169964:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.170014:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a7670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672792.170308:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564345984 00000100:00100000:0.0:1789672792.170316:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564345984 00000100:00100000:0.0:1789672792.170369:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672792.170378:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14434:x1876607564345984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789672792.170418:0:15094:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789672792.174255:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14434:x1876607564345984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3870us (4283us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789672792.174267:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672792.174337:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14434:1876607564345984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789672792.174353:0:14434:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1789672792.371946:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672793.395013:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789672794.401004:0:15816:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789672794.401009:0:15816:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789672794.401149:0:15816:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa602f4d800 00000020:01000004:3.0:1789672794.401165:0:15816:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789672794.401179:0:15816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789672794.401192:0:15816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fa63a3ab380) 00000020:00000080:3.0:1789672794.401213:0:15816:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1789672794.419911:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789672794.436886:0:15816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789672794.437312:0:15816:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789672794.438455:0:15816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789672794.439032:0:15816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789672794.439441:0:15816:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789672794.440087:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:2.0:1789672794.440183:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 417: rc = 0 00100000:10000000:2.0:1789672794.440442:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:2.0:1789672794.441097:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 370: rc = 0 00100000:10000000:2.0:1789672794.441389:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 370: rc = 0 00100000:10000000:2.0:1789672794.443621:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 370: rc = 0 00100000:10000000:2.0:1789672794.444145:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 370: rc = 0 00100000:10000000:2.0:1789672794.444469:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 370: rc = 0 00100000:10000000:2.0:1789672794.444779:0:15816:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 370: rc = 0 00000020:00000080:2.0:1789672794.446470:0:15816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789672794.446483:0:15816:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789672794.446494:0:15816:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2247cb9491d09a76 00000020:01000004:2.0:1789672794.446503:0:15816:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789672794.446523:0:15816:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789672794.446526:0:15816:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789672794.446531:0:15816:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789672794.446551:0:15816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789672794.446555:0:15816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789672794.459079:0:15816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789672794.459117:0:15816:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.139@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789672794.459123:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789672794.459124:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789672794.459126:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672794.459127:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672794.459129:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672794.459130:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672794.459131:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672794.459133:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672794.459135:0:15816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789672794.459139:0:15816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789672794.459141:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789672794.459143:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789672794.459144:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672794.459145:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672794.459146:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672794.459147:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672794.459148:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672794.459149:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672794.459150:0:15816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789672794.459190:0:15816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789672794.459212:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789672794.459291:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672794.461182:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa618635e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672794.463600:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346112 00000100:00100000:2.0:1789672794.463616:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346112 00000100:00100000:2.0:1789672794.463898:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789672794.463909:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15816:x1876607564346112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789672794.467181:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789672794.467190:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789672794.467195:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789672794.485323:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15816:x1876607564346112:12345-0@lo:253:mount.lustre.0 Request processed in 21405us (26021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.485341:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789672794.485538:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789672794.485556:0:15816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789672794.485560:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672794.485562:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672794.485581:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672794.485583:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672794.485584:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672794.485586:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672794.485588:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672794.485590:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672794.485591:0:15816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789672794.485616:0:15816:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa602f4d800 from lustre-OST0001 10000000:01000000:2.0:1789672794.485644:0:15816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789672794.485648:0:15816:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789672794.485656:0:15816:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa611cab380 local copy 00010000:00010000:2.0:1789672794.485667:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672794.485968:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672794.486010:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.486052:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610f1c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.486556:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346240 00000100:00100000:3.0:1789672794.486565:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346240 00000100:00100000:3.0:1789672794.486617:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789672794.486627:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15816:x1876607564346240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672794.486843:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15816:x1876607564346240:12345-0@lo:501:mount.lustre.0 Request processed in 216us (832us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672794.486851:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789672794.486953:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346240:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789672794.486969:0:15816:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789672794.487109:0:15816:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789672794.487119:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.487130:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542ec00/0x2247cb9491d0981c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09823 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672794.487154:0:15816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa602f4d800 10000000:01000000:2.0:1789672794.487160:0:15816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789672794.487165:0:15816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789672794.487167:0:15816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789672794.487172:0:15816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789672794.487181:0:15816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789672794.487208:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.487228:0:15816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.487239:0:15816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672794.487255:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789672794.487288:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.487323:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610f1c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.487505:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346368 00000100:00100000:3.0:1789672794.487510:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346368 00000100:00100000:3.0:1789672794.487547:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789672794.487555:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:15816:x1876607564346368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672794.487573:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672794.487588:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d09a84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09a7d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.487610:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d09a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09a7d expref: 17 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.487621:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67c600/0x2247cb9491d09a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09a7d expref: 17 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.487631:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c600, rc 0) 00000100:00100000:3.0:1789672794.487662:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346368:12345-0@lo:101:mount.lustre.0 Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.487668:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789672794.487759:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672794.487771:0:15816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09a84 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.487780:0:15816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09a84 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672794.488622:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789672794.489730:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672794.490170:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789672794.490444:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789672794.490488:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789672794.490555:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789672794.490593:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789672794.490632:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789672794.490707:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789672794.490716:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789672794.490853:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672794.491481:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.491569:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672794.495051:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346496 00000100:00100000:1.0:1789672794.495070:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346496 00000100:00100000:0.0:1789672794.495303:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789672794.495332:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672794.495774:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346496:12345-0@lo:501:mount.lustre.0 Request processed in 445us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672794.495782:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672794.495852:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672794.495904:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672794.495963:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.496043:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.496144:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346624 00000100:00100000:3.0:1789672794.496150:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346624 00000100:00100000:3.0:1789672794.496185:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789672794.496192:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789672794.505141:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346624:12345-0@lo:503:mount.lustre.0 Request processed in 8940us (9168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.505156:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789672794.506607:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a21a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346624:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789672794.507770:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789672794.507892:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672794.507969:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672794.508022:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610322cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672794.508171:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346752 00000100:00100000:2.0:1789672794.508179:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346752 00000100:00100000:2.0:1789672794.508234:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789672794.508244:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789672794.508527:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346752:12345-0@lo:502:mount.lustre.0 Request processed in 284us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.508536:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789672794.508628:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789672794.508931:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789672794.508982:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789672794.509022:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789672794.509070:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789672794.509109:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789672794.509145:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789672794.509195:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789672794.509231:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789672794.509281:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789672794.509311:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672794.509359:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672794.509392:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610322cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.509686:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564346880 00000100:00100000:3.0:1789672794.509692:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564346880 00000100:00100000:3.0:1789672794.509727:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789672794.509734:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672794.509954:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564346880:12345-0@lo:502:mount.lustre.0 Request processed in 219us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.509962:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789672794.510068:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564346880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789672794.510156:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789672794.510168:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789672794.511341:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789672794.511353:0:15817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789672794.511362:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672794.511364:0:15817:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789672794.511372:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789672794.511405:0:15817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fa62f3c4d40) 00000020:00000080:1.0:1789672794.511432:0:15817:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789672794.511440:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789672794.511512:0:15817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa602f4d800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789672794.511520:0:15817:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789672794.511526:0:15817:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2247cb9491d09a92 00010000:00010000:0.0:1789672794.524567:0:15817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789672794.525219:0:15817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789672794.528340:0:15817:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789672794.529572:0:15817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789672794.529585:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672794.529595:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.529597:0:15817:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789672794.529600:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672794.529605:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.529606:0:15817:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789672794.529609:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789672794.529611:0:15817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789672794.529613:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672794.529616:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.529617:0:15817:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789672794.529619:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672794.529621:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.529623:0:15817:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789672794.529625:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789672794.529675:0:15817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672794.529678:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.529679:0:15817:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789672794.529682:0:15817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789672794.529892:0:15816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789672794.529917:0:15816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789672794.529940:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09a84 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.529953:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929e000/0x2247cb9491d09a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09a84 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672794.529962:0:15816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa602f4d800 from 1 10000000:01000000:2.0:1789672794.529965:0:15816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672794.530007:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.530016:0:15816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.530028:0:15816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672794.530051:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789672794.530117:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.530160:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347008 00000100:00100000:2.0:1789672794.530168:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347008 00000100:00100000:2.0:1789672794.530207:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672794.530215:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:15816:x1876607564347008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672794.530228:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672794.530240:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09a99 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.530264:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.530275:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.530283:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa60929fa00, rc 0) 00000100:00100000:2.0:1789672794.530316:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347008:12345-0@lo:101:mount.lustre.0 Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.530322:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672794.530375:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082de600 going to sleep for 11 seconds 00000100:00100000:2.0:1789672794.530397:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789672794.530413:0:15816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672794.530422:0:15816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672794.532308:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789672794.533011:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672794.533253:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789672794.533298:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789672794.533362:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789672794.533371:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789672794.533447:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789672794.533515:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.533557:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082de600 going to sleep for 11 seconds 00000100:00100000:0.0:1789672794.535620:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347136 00000100:00100000:0.0:1789672794.535632:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347136 00000100:00100000:0.0:1789672794.535680:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672794.535690:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672794.536002:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347136:12345-0@lo:501:mount.lustre.0 Request processed in 313us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672794.536010:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672794.536954:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789672794.537010:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789672794.537068:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672794.537154:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.538666:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347264 00000100:00100000:3.0:1789672794.538678:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347264 00000100:00100000:3.0:1789672794.538749:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789672794.538768:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789672794.539010:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347264:12345-0@lo:503:mount.lustre.0 Request processed in 244us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.539018:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789672794.539138:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347264:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789672794.539640:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789672794.539714:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789672794.539777:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.539835:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082de600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.539893:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347392 00000100:00100000:3.0:1789672794.539898:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347392 00000100:00100000:3.0:1789672794.539929:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789672794.539936:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672794.540089:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347392:12345-0@lo:502:mount.lustre.0 Request processed in 153us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.540096:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789672794.540155:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789672794.540372:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789672794.540416:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789672794.540470:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789672794.540510:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789672794.540552:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789672794.540595:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789672794.540628:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789672794.540659:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789672794.540685:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672794.540726:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.540763:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347520 00000100:00100000:3.0:1789672794.540767:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347520 00000100:00100000:3.0:1789672794.540814:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789672794.540822:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672794.540951:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347520:12345-0@lo:502:mount.lustre.0 Request processed in 129us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.540964:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789672794.540996:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.541010:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789672794.541080:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789672794.541088:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789672794.548355:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672794.548372:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.548374:0:15821:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789672794.548381:0:15821:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa602f4d800 00000020:00000080:0.0:1789672794.548384:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789672794.548391:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672794.548394:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.548404:0:15821:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789672794.548408:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672794.548412:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.548414:0:15821:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789672794.548417:0:15821:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa602f4d800 00000020:00000080:0.0:1789672794.548420:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789672794.548471:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672794.548474:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.548476:0:15821:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789672794.548479:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672794.548481:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.548483:0:15821:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789672794.548486:0:15821:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa602f4d800 00000020:00000080:0.0:1789672794.548489:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789672794.548527:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672794.548531:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672794.548532:0:15821:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789672794.548536:0:15821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789672794.551863:0:15816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789672794.551909:0:15816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789672794.551931:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.551945:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672794.552001:0:15816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789672794.552004:0:15816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa602f4d800 10000000:01000000:3.0:1789672794.552007:0:15816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa602f4d800 10000000:01000000:3.0:1789672794.552012:0:15816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789672794.552017:0:15816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa602f4d800 from 1 10000000:01000000:3.0:1789672794.552020:0:15816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672794.552058:0:15816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.552068:0:15816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.552080:0:15816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672794.552104:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789672794.552181:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.552225:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347648 00000100:00100000:3.0:1789672794.552232:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347648 00000100:00100000:3.0:1789672794.552277:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672794.552286:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564347648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672794.552299:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672794.552312:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67c000/0x2247cb9491d09aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09aa7 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.552337:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67c000/0x2247cb9491d09aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09aa7 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.552348:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67c000/0x2247cb9491d09aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09aa7 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.552355:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c000, rc 0) 00000100:00100000:3.0:1789672794.552389:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564347648:12345-0@lo:101:mount.lustre.0 Request processed in 104us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.552396:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672794.552442:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.552468:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789672794.552482:0:15816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09aae expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.552491:0:15816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09aae expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672794.553127:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789672794.556950:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672794.557294:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789672794.557331:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789672794.557349:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789672794.557375:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789672794.557394:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789672794.557418:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789672794.557451:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789672794.557468:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789672794.557494:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789672794.557512:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789672794.557528:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789672794.557551:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789672794.557569:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789672794.557585:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789672794.557619:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789672794.557644:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789672794.557678:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789672794.557715:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789672794.557734:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789672794.557772:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789672794.557817:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789672794.557838:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789672794.557871:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789672794.557897:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789672794.557916:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789672794.557947:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789672794.557992:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789672794.558015:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789672794.558032:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789672794.558057:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789672794.558074:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789672794.558091:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789672794.558118:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789672794.558143:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789672794.558161:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789672794.558184:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789672794.558201:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789672794.558270:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789672794.558279:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789672794.558365:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672794.558418:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.558448:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672794.559966:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347776 00000100:00100000:0.0:1789672794.559977:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347776 00000100:00100000:0.0:1789672794.560028:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789672794.560038:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564347776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789672794.560311:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564347776:12345-0@lo:501:mount.lustre.0 Request processed in 273us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672794.560319:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789672794.560326:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789672794.560370:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789672794.560414:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.560448:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672794.560464:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564347904 00000100:00100000:3.0:1789672794.560468:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564347904 00000100:00100000:3.0:1789672794.560491:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789672794.560497:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564347904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789672794.560635:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564347904:12345-0@lo:503:mount.lustre.0 Request processed in 137us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.560655:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789672794.560691:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564347904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789672794.561202:0:15816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789672794.561248:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564348032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672794.561277:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.561304:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672794.561318:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348032 00000100:00100000:0.0:1789672794.561324:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348032 00000100:00100000:0.0:1789672794.561367:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789672794.561373:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564348032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672794.561552:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564348032:12345-0@lo:502:mount.lustre.0 Request processed in 178us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.561557:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564348032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789672794.561564:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000040:00080000:3.0:1789672794.561768:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789672794.561836:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789672794.561873:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789672794.561922:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789672794.561959:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789672794.562008:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789672794.562046:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789672794.562081:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789672794.562130:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789672794.562167:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789672794.562198:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789672794.562243:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789672794.562281:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789672794.562331:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789672794.562379:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789672794.562414:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789672794.562446:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789672794.562493:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789672794.562527:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789672794.562559:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789672794.562616:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789672794.562654:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789672794.562688:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789672794.562734:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789672794.565878:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789672794.566010:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789672794.566084:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789672794.566121:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789672794.566156:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789672794.566347:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789672794.566388:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789672794.566428:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789672794.566460:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789672794.566511:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789672794.566549:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789672794.566597:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789672794.566633:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789672794.566774:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789672794.566908:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789672794.567030:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789672794.567082:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564348160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789672794.567164:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.567374:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672794.571485:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348160 00000100:00100000:1.0:1789672794.571504:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348160 00000100:00100000:1.0:1789672794.571561:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789672794.571571:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564348160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789672794.571903:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564348160:12345-0@lo:502:mount.lustre.0 Request processed in 333us (4738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672794.571911:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789672794.573721:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564348160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789672794.573887:0:15816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789672794.573905:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789672794.577820:0:15826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789672794.577836:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fa63a3a99c0) 00000020:00000080:3.0:1789672794.577857:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789672794.577940:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa602f4d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789672794.577944:0:15826:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa602f4d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789672794.577946:0:15826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa602f4d800 3 00010000:00080000:3.0:1789672794.577975:0:15826:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa501e0e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.139@tcp at head 00010000:00010000:3.0:1789672794.579469:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789672794.580858:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789672794.580894:0:15826:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789672794.580907:0:15826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2247cb9491d09abc 00000100:00080000:3.0:1789672794.580918:0:15826:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789672794.580929:0:15826:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa501e0e000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:3.0:1789672794.580964:0:15826:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa62f0f6300 x1876607564348288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672794.581009:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564348288:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789672794.581086:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.581148:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348288 00000100:00100000:3.0:1789672794.581156:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348288 00000100:00100000:3.0:1789672794.581187:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672794.581195:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1876607564348288:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789672794.582654:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1789672794.582692:0:14411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2247cb9491d09ac3 00000004:00100000:3.0:1789672794.582707:0:14411:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789672794.582737:0:14411:0:(import.c:65:import_set_state_nolock()) ffff9fa501e0f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672794.582831:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876607564348288:12345-0@lo:38:llog_process_th.0 Request processed in 1635us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.582841:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789672794.582900:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa62f0f6300 x1876607564348288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672794.582912:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672794.582931:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789672794.582939:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789672794.582943:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789672794.582945:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa501e0e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789672794.582951:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1876607564348288:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789672794.589535:0:15826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1789672794.590064:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789672794.590639:0:15816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789672794.590670:0:15816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789672794.591026:0:15816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09aae expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.591039:0:15816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63f67c800/0x2247cb9491d09aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09aae expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789672794.591085:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789672794.591088:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789672794.591089:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789672794.591090:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789672794.591091:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789672794.591093:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789672794.591094:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789672794.591100:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789672794.591102:0:15816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789672794.591105:0:15816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789672794.591107:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789672794.591109:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789672794.591109:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789672794.591110:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789672794.591111:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789672794.591112:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789672794.591113:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789672794.591114:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789672794.591115:0:15816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789672794.591135:0:15816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789672794.591152:0:15816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564348544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789672794.591429:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564348416:0@lo:400:kworker.0 00000100:00080000:1.0:1789672794.591474:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789672794.591479:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789672794.591483:0:469:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789672794.591488:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1789672794.591493:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1789672794.591642:0:15816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672794.591654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.591688:0:15816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330eac00 going to sleep for 11 seconds 00000100:00080000:1.0:1789672794.591693:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa6209e6000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:1.0:1789672794.591717:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa63f781f80 x1876607564348672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672794.591756:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564348800:0@lo:400:kworker.0 00000100:00100000:1.0:1789672794.591781:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564348672:0@lo:8:kworker.0 00000100:00100000:3.0:1789672794.591801:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672794.591837:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.591850:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348416 00000100:00100000:3.0:1789672794.591857:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348416 00000100:00100000:1.0:1789672794.591866:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672794.591873:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564348928:0@lo:400:kworker.0 00000100:00100000:1.0:1789672794.591894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.591904:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348672 00000100:00100000:3.0:1789672794.591907:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348672 00000100:00100000:3.0:1789672794.591927:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672794.591936:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1876607564348416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672794.591979:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1876607564348416:12345-0@lo:400:kworker.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.591986:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672794.592001:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672794.592005:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3298:x1876607564348672:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789672794.592080:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672794.592088:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789672794.592092:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789672794.592095:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564348672:0@lo:8:kworker.0 00000100:00100000:3.0:1789672794.592115:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3298:x1876607564348672:12345-0@lo:8:kworker.0 Request processed in 107us (276us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789672794.592121:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672794.592150:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348800 00000100:00100000:3.0:1789672794.592154:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348800 00000100:00100000:2.0:1789672794.592202:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564348416:0@lo:400:kworker.0 00000100:00100000:3.0:1789672794.592208:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348928 00000100:00100000:3.0:1789672794.592211:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348928 00000100:00100000:2.0:1789672794.592226:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564348544 00000100:00100000:2.0:1789672794.592230:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564348544 00000100:00100000:2.0:1789672794.592266:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789672794.592273:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:15816:x1876607564348544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789672794.592294:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789672794.592314:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789672794.592327:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672794.592334:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564348800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672794.592374:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876607564348800:12345-0@lo:400:kworker.0 Request processed in 41us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672794.592380:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672794.592393:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672794.592398:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564348928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672794.592426:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876607564348928:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672794.592432:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789672794.592536:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672794.592542:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672794.592572:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa63f782300 x1876607564348800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672794.592584:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876607564348800:0@lo:400:kworker.0 00010000:00080000:1.0:1789672794.592667:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa63f782d80 x1876607564348928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672794.592676:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1876607564348928:0@lo:400:kworker.0 20000000:01000000:1.0:1789672794.609186:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789672794.609199:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789672794.609505:0:14427:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789672794.609510:0:14427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789672794.609532:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.609551:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09996 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.609561:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.609603:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d09996 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.609618:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d09996 expref: 19 pid: 14406 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672794.609640:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1876607564349056:0@lo:104: 00000100:00100000:1.0:1789672794.609705:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672794.609753:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672794.609777:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349056 00000100:00100000:1.0:1789672794.609801:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349056 00000100:00100000:1.0:1789672794.609844:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672794.609852:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14427:x1876607564349056:12345-0@lo:104: 00010000:00010000:1.0:1789672794.609864:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.609925:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789672794.609931:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:14427:x1876607564349056:12345-0@lo:104: Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672794.609938:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672794.609980:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14427:1876607564349056:0@lo:104: 00010000:00010000:3.0:1789672794.609990:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672794.609997:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.609997:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610005:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672794.610008:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610017:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672794.610025:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672794.610031:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789672794.610067:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610074:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672794.610094:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610112:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929f600/0x2247cb9491d09996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d0999d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610127:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672794.610129:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672794.610131:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672794.610139:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672794.610149:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564349184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672794.610182:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672794.610220:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349184 00000100:00100000:3.0:1789672794.610225:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349184 00010000:00010000:3.0:1789672794.610244:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d09996 expref: 20 pid: 14406 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672794.610266:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672794.610272:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+20:3299:x1876607564349184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672794.610282:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672794.610287:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d09996 expref: 20 pid: 14406 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610298:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d09996 expref: 20 pid: 14406 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610311:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542e600/0x2247cb9491d0999d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d09996 expref: 20 pid: 14406 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610328:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610346:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672794.610360:0:14398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002614432s 00010000:00010000:3.0:1789672794.610364:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610371:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610378:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610384:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610390:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672794.610394:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610401:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610413:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672794.610422:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672794.610544:0:14427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.610553:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672794.610559:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542e400/0x2247cb9491d09aca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672794.616672:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3299:x1876607564349184:12345-0@lo:103:ldlm_bl.0 Request processed in 6390us (6479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672794.616687:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672794.616774:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3299:1876607564349184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672794.624128:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:15816:x1876607564348544:12345-0@lo:253:mount.lustre.0 Request processed in 31848us (32480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672794.624156:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789672794.624252:0:15816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:15816:1876607564348544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789672794.624268:0:15816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789672794.624272:0:15816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789672794.624274:0:15816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789672794.624275:0:15816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789672794.624277:0:15816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789672794.624278:0:15816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789672794.624280:0:15816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789672794.624281:0:15816:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789672794.624283:0:15816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789672794.624284:0:15816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789672794.624300:0:15816:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789672794.629142:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672794.629294:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672794.629514:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672794.629634:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789672794.629890:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789672794.630090:0:15816:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789672794.631904:0:15816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789672794.661101:0:15816:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789672794.661110:0:15816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789672794.661147:0:15816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789672794.661219:0:15816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789672794.661234:0:15816:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789672794.661264:0:15816:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789672795.445846:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672795.758999:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789672795.759040:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:1.0:1789672795.826951:0:14408:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789672795.826963:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa6186e7800 from 8 10000000:01000000:1.0:1789672795.826971:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672795.827058:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672795.827073:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672795.827406:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672795.827507:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564349312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672795.827608:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672795.830298:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63518c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672795.833596:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349312 00000100:00100000:3.0:1789672795.833620:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349312 00000100:00100000:3.0:1789672795.833756:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789672795.833770:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564349312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672795.833810:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672795.833837:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67d200/0x2247cb9491d09ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09ad1 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672795.833887:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67d200/0x2247cb9491d09ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09ad1 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672795.833901:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67d200/0x2247cb9491d09ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09ad1 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672795.833921:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d200, rc 0) 00000100:00100000:3.0:1789672795.834348:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564349312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 579us (6738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672795.834356:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789672795.834445:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564349312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672795.834473:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09ad8 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672795.834485:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09ad8 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672795.834571:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564349440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789672795.834621:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672795.838463:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa610f1c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672795.839266:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349440 00000100:00100000:1.0:1789672795.839284:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349440 00000100:00100000:1.0:1789672795.839349:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789672795.839360:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564349440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789672795.839396:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789672795.839428:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789672795.839432:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789672795.839615:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564349440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 256us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672795.839625:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789672795.839674:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564349440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789672795.839768:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789672795.839809:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09ad8 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672795.839822:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542e000/0x2247cb9491d09ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09ad8 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672796.467288:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672797.107593:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672797.107625:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672797.107747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672797.108002:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349568 00000100:00100000:1.0:1789672797.108015:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349568 00000100:00100000:1.0:1789672797.108107:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672797.108118:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564349568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672797.108166:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672797.108230:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564349568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672797.108238:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789672797.108662:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672797.108706:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789672797.108751:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564349568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672797.494858:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672798.515116:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.550878:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789672799.667125:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789672799.667134:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789672799.667138:0:469:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789672799.667161:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa6209e6000 using connection 192.168.202.139@tcp/0@lo 00000100:00100000:3.0:1789672799.667190:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa62f0f5880 x1876607564349952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672799.672309:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564350208:0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.672400:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.672477:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789672799.672484:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564349696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.672512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.672535:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564350336:0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.672553:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.672598:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564349824:0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.672629:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.672649:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672799.672654:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564350080:0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.672916:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.672968:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350208 00000100:00100000:3.0:1789672799.672979:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350208 00000100:00100000:3.0:1789672799.673041:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350336 00000100:00100000:3.0:1789672799.673045:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350336 00000100:00100000:3.0:1789672799.673059:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350080 00000100:00100000:3.0:1789672799.673062:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350080 00000100:00100000:3.0:1789672799.673079:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789672799.673089:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.673154:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564350208:12345-0@lo:400:kworker.0 Request processed in 66us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.673162:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789672799.673181:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789672799.673188:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564350336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.673215:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564350336:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.673221:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789672799.673234:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672799.673239:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564350080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.673273:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564350080:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.673279:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672799.673300:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349696 00000100:00100000:3.0:1789672799.673311:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349696 00000100:00100000:3.0:1789672799.673339:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672799.673346:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3301:x1876607564349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.673380:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3301:x1876607564349696:12345-0@lo:400:kworker.0 Request processed in 35us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.673386:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672799.673420:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349824 00000100:00100000:3.0:1789672799.673424:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349824 00000100:00100000:3.0:1789672799.673452:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672799.673461:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564349824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.673491:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564349824:12345-0@lo:400:kworker.0 Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.673497:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789672799.673542:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672799.673547:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672799.673576:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564349696:0@lo:400:kworker.0 00010000:00080000:3.0:1789672799.673591:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f0f5c00 x1876607564350336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672799.673603:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564350336:0@lo:400:kworker.0 00010000:00080000:3.0:1789672799.673613:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f0f6a00 x1876607564350208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672799.673621:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564350208:0@lo:400:kworker.0 00010000:00080000:3.0:1789672799.673661:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f0f5180 x1876607564350080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672799.673671:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564350080:0@lo:400:kworker.0 00000100:00100000:1.0:1789672799.673813:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa62f0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564349952:0@lo:8:kworker.0 00000100:00100000:1.0:1789672799.673856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.680943:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564349824:0@lo:400:kworker.0 00000100:00100000:3.0:1789672799.681028:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564349952 00000100:00100000:3.0:1789672799.681038:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564349952 00000100:00100000:3.0:1789672799.681094:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789672799.681103:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3298:x1876607564349952:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789672799.681145:0:15712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1789672799.681188:0:15712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2247cb9491d09adf 00002000:00100000:3.0:1789672799.681204:0:15712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fa501e0a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789672799.681209:0:15712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789672799.681212:0:15712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789672799.681656:0:15712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789672799.684288:0:15712:0:(import.c:65:import_set_state_nolock()) ffff9fa501e0b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672799.684452:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876607564349952:12345-0@lo:8:kworker.0 Request processed in 3343us (10589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.684466:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789672799.684942:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa62f0f5880 x1876607564349952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789672799.684964:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789672799.684975:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789672799.684983:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789672799.684986:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9fa6209e6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789672799.685012:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789672799.685018:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa62f0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1876607564349952:0@lo:8:kworker.0 00000004:00080000:0.0:1789672799.685058:0:14435:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789672799.685626:0:14435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 468466838764ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789672799.686851:0:14436:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789672799.686888:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1876607564350592:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789672799.686976:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.687015:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa62f15cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672799.687149:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350592 00000100:00100000:3.0:1789672799.687159:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350592 00000100:00100000:0.0:1789672799.687290:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672799.687304:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564350464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672799.687340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672799.687379:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350464 00000100:00100000:0.0:1789672799.687384:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350464 00000100:00100000:0.0:1789672799.687426:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672799.687435:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564350464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672799.687473:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672799.687524:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564350464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672799.687531:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789672799.688562:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672799.688577:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14436:x1876607564350592:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:0.0:1789672799.690173:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa604a0d880 x1876607564350464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672799.690615:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564350464:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672799.705757:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789672799.708763:0:15095:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789672799.708779:0:15095:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789672799.708826:0:15095:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1789672799.733153:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789672799.733168:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733190:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789672799.733195:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672799.733203:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733224:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733235:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733244:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733270:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672799.733289:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672799.733296:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733305:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67da00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672799.733310:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733335:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733355:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733363:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a8290c/0x2247cb9491d09ae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.733385:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.733387:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.733389:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789672799.734279:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789672799.734289:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.734303:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789672799.734307:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672799.734313:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.734325:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.734334:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.734349:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.734366:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672799.735935:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672799.735951:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.735968:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.735974:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736001:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736029:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736038:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6095dd8/0x2247cb9491d09aed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736063:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.736065:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.736068:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789672799.736137:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789672799.736146:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.736159:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789672799.736164:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672799.736170:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.736184:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.736194:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.736203:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.736227:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672799.736280:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672799.736286:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736295:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.736299:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736308:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736320:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736340:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc058e64/0x2247cb9491d09af4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.736354:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.736357:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.736359:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.737252:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.737261:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.737273:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.737278:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.737283:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.737296:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.737306:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.737313:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.737337:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.738056:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.738071:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738082:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.738086:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.738091:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738102:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738112:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738119:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738139:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789672799.738154:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672799.738160:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738168:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.738173:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738182:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738206:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738214:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd193ee4/0x2247cb9491d09afb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738231:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672799.738234:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738241:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.738244:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738251:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738260:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738267:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011238a94/0x2247cb9491d09b02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.738279:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.738281:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.738289:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.738813:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.739058:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.739066:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.739077:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.739081:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.739087:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.739099:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.739109:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.739117:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.739181:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.739961:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.739970:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.739984:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.739988:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.739994:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.740019:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.740029:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.740038:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.743954:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789672799.743986:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744004:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672799.744010:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744024:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744049:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744057:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000005f6508/0x2247cb9491d09b09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744083:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672799.744088:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744095:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672799.744097:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744104:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744126:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.744134:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.744136:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.744138:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.752729:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.752735:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789672799.752751:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091088894/0x2247cb9491d09b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672799.753485:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.753493:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.753511:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.753516:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.753524:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.753540:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.753565:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.753573:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.753598:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672799.753637:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.753648:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.753660:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.753666:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.753678:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.753714:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.753723:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003294804c/0x2247cb9491d09b17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.753744:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.753746:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.753749:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.754072:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.754078:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754086:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.754089:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.754094:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754103:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754111:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754118:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754149:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672799.754170:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.754177:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754185:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.754189:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754206:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754220:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754227:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000910a6a5d/0x2247cb9491d09b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754245:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.754247:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.754250:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.754558:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.754565:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754573:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.754577:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.754581:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754590:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754597:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754604:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.754622:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672799.754644:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.754650:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754659:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929ec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.754663:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754672:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754686:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754719:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfec400/0x2247cb9491d09b25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.754737:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.754740:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.754742:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.755081:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.755087:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755096:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.755106:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.755110:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755121:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755130:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755136:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755152:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672799.755175:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.755181:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755190:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.755194:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755203:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755216:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755224:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088f64aa0/0x2247cb9491d09b2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755242:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.755244:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.755246:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.755565:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.755570:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755580:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.755583:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.755588:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755598:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755606:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755619:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.755636:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672799.755661:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.755668:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755677:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.755681:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755701:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755714:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755721:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd1a075/0x2247cb9491d09b33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.755738:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.755740:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.755741:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.761392:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.761411:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.761434:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.761439:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.761448:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.761464:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.761476:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.761485:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.761506:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.762007:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.762019:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762036:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.762040:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.762044:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762052:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762060:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762067:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762082:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789672799.762475:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.762482:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762491:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.762494:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.762498:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762508:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762526:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762534:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762557:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789672799.762578:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789672799.762585:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762592:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421efe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.762597:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762607:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762627:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762635:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b5fb7fc/0x2247cb9491d09b3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762660:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672799.762670:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762677:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ef200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.762681:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762699:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762712:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762720:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8df853/0x2247cb9491d09b41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762734:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672799.762737:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762743:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672799.762746:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762753:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762776:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762824:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d278396/0x2247cb9491d09b48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.762841:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.762843:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.762844:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.763011:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.763580:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.764501:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.764515:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.764532:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.764537:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.764543:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.764558:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.764569:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.764577:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.767024:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672799.768011:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.768026:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.768042:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421efa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.768048:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.768078:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.768103:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.768110:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006891e6e0/0x2247cb9491d09b4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.768137:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.768139:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.768141:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.768476:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.768485:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.768500:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.768505:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.768512:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.768525:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.768534:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.768542:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.768569:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.769264:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.769273:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.769283:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.769294:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.769300:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.769310:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.769320:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.769327:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.769354:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789672799.770040:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672799.770049:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770062:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.770067:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770078:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770097:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770131:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061d60ce9/0x2247cb9491d09b56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770153:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.770156:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770162:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421eec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.770166:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770174:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770185:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770193:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da3d2ec/0x2247cb9491d09b5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.770206:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.770208:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.770210:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.770457:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.770464:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.770474:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.770478:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.770482:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.770493:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.770502:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.770517:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.770574:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.771495:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.771504:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.771517:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.771520:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.771525:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.771536:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.771545:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.771553:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771815:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672799.771823:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771840:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ef000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.771845:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771856:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771872:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771879:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f864bbeb/0x2247cb9491d09b64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771900:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.771904:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771910:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa6421ee800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.771914:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771921:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771931:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.771946:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.771948:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.771950:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.772956:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789672799.772968:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e21f55/0x2247cb9491d09b6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672799.773674:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.773682:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.773991:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.774153:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.774159:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.774166:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.774182:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.774193:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.774201:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.774220:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672799.774807:0:15717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672799.774815:0:15717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.774825:0:15717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333a600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672799.774830:0:15717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.774841:0:15717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.774860:0:15717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.774869:0:15717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3070bcb/0x2247cb9491d09b72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.774890:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.774898:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.774900:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.774992:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789672799.775081:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.775088:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.775096:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.775394:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.775409:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.775423:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.775433:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.775440:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.775501:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.776051:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.776059:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.776069:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.776072:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.776077:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.776085:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.776093:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.776110:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776262:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789672799.776269:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776277:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333aa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672799.776281:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776290:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776306:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776313:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165003cc/0x2247cb9491d09b79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776330:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672799.776333:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776340:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333a200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672799.776343:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776365:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776375:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672799.776383:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.776384:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.776386:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672799.776547:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789672799.776553:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa0600c9/0x2247cb9491d09b80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672799.777070:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.777076:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777086:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.777089:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.777094:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777119:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777128:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777135:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777167:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789672799.777577:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.777583:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777592:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.777596:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.777600:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777610:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777618:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777624:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.777638:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789672799.778141:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.778148:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778158:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.778168:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.778173:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778182:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778190:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778198:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778205:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789672799.778601:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789672799.778607:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778616:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789672799.778619:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672799.778623:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778633:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778640:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778654:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672799.778661:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1789672799.778879:0:15095:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789672799.779017:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14436:x1876607564350592:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90439us (92035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672799.779028:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672799.779113:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1876607564350592:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789672799.779134:0:14436:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789672799.779192:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1876607564350720:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789672799.779232:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672799.779288:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672799.779314:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350720 00000100:00100000:2.0:1789672799.779322:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350720 00000100:00100000:2.0:1789672799.779371:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789672799.779382:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1876607564350720:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789672799.779436:0:15093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1789672799.780087:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789672799.780097:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780108:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333ae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.780113:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780123:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780144:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780151:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f5e8da5/0x2247cb9491d09b87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780174:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789672799.780179:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780186:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.780203:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780213:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780226:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780231:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f6ef1c/0x2247cb9491d09b8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780242:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672799.780246:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780252:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333bc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.780255:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780261:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780270:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780276:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a1aaf1b/0x2247cb9491d09b95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780294:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672799.780298:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780304:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672799.780306:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780313:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780323:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780331:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ba9e3f7/0x2247cb9491d09b9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672799.780343:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.780345:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672799.780347:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.780419:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672799.780426:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672799.786575:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14436:x1876607564350720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7184us (7332us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789672799.786592:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672799.789265:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14436:1876607564350720:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789672799.789293:0:14436:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1789672799.789413:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000040:00080000:3.0:1789672799.996937:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789672800.566105:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789672801.477971:0:16172:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789672801.595086:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672802.232247:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672802.243048:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564350848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672802.243152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672802.243239:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350848 00000100:00100000:3.0:1789672802.243247:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350848 00000100:00100000:3.0:1789672802.243302:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789672802.243311:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564350848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672802.243351:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672802.243406:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564350848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672802.243425:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789672802.243449:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672802.243499:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564350848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672802.612154:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672803.638394:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672804.007094:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.007232:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386240 00000100:00100000:1.0:1789672804.007244:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386240 00000100:00100000:1.0:1789672804.007296:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:1.0:1789672804.007305:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1876607543386240:12345-192.168.202.39@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789672804.007338:0:14405:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed@192.168.202.39@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1789672804.007370:0:14405:0:(genops.c:1384:class_connect()) connect: client 0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed, cookie 0x2247cb9491d09ba3 00000100:00080000:1.0:1789672804.007513:0:14405:0:(import.c:65:import_set_state_nolock()) ffff9fa63a9c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672804.007593:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+5:2356:x1876607543386240:12345-192.168.202.39@tcp:250:mount.lustre.0 Request processed in 287us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.007601:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 75 00000100:00100000:0.0:1789672804.013141:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672804.013234:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386368 00000100:00100000:3.0:1789672804.013246:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386368 00000100:00100000:3.0:1789672804.013307:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:3.0:1789672804.013318:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+5:13733:x1876607543386368:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789672804.013345:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672804.013362:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67da00/0x2247cb9491d09baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb96 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.013400:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67da00/0x2247cb9491d09baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb96 expref: 6 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.013412:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67da00/0x2247cb9491d09baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb96 expref: 6 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.013420:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67da00, rc 0) 00000100:00100000:3.0:1789672804.013476:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+6:13733:x1876607543386368:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 160us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.013482:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 76 00000100:00100000:2.0:1789672804.016614:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.016720:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386496 00000100:00100000:1.0:1789672804.016731:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386496 00000100:00100000:1.0:1789672804.016820:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 77 00000100:00100000:1.0:1789672804.016841:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+6:13733:x1876607543386496:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789672804.017179:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+6:13733:x1876607543386496:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 349us (573us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789672804.017188:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 77 00000100:00100000:0.0:1789672804.021220:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.021482:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386624 00000100:00100000:1.0:1789672804.021493:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386624 00000100:00100000:1.0:1789672804.021600:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 78 00000100:00100000:1.0:1789672804.021611:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+6:13733:x1876607543386624:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789672804.021629:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672804.021661:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542f400/0x2247cb9491d09bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfb9d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672804.021694:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542f400/0x2247cb9491d09bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb9d expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672804.021705:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542f400/0x2247cb9491d09bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfb9d expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672804.021715:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f400, rc 0) 00000100:00100000:1.0:1789672804.021780:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+7:13733:x1876607543386624:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 171us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.021814:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 78 00000100:00100000:2.0:1789672804.024206:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672804.035942:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386752 00000100:00100000:0.0:1789672804.035957:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386752 00000100:00100000:0.0:1789672804.036009:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:0.0:1789672804.036019:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+7:13733:x1876607543386752:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789672804.037541:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13733:x1876607543386752:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 1515us (13335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.037554:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 79 00000100:00100000:2.0:1789672804.045673:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672804.048761:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543386880 00000100:00100000:0.0:1789672804.048783:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543386880 00000100:00100000:1.0:1789672804.049067:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:1.0:1789672804.049092:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13733:x1876607543386880:12345-192.168.202.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789672804.049478:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13733:x1876607543386880:12345-192.168.202.39@tcp:503:mount.lustre.0 Request processed in 396us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.049486:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 80 00000100:00100000:2.0:1789672804.055424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672804.055558:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387008 00000100:00100000:3.0:1789672804.055571:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387008 00000100:00100000:3.0:1789672804.055716:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:3.0:1789672804.055731:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13752:x1876607543387008:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672804.056282:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13752:x1876607543387008:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 551us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.056301:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 81 00000100:00100000:2.0:1789672804.073724:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.073861:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387136 00000100:00100000:1.0:1789672804.073872:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387136 00000100:00100000:1.0:1789672804.073936:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 82 00000100:00100000:1.0:1789672804.073947:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13752:x1876607543387136:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672804.074233:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13752:x1876607543387136:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 286us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.074241:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 82 00000100:00100000:2.0:1789672804.080151:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672804.081515:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387264 00000100:00100000:3.0:1789672804.081539:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387264 00000100:00100000:3.0:1789672804.081621:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 83 00000100:00100000:3.0:1789672804.081633:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+8:13733:x1876607543387264:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789672804.081668:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672804.081696:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d09bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfbc7 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.081736:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d09bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbc7 expref: 9 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.081749:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67ce00/0x2247cb9491d09bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbc7 expref: 9 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.081760:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67ce00, rc 0) 00000100:00100000:3.0:1789672804.081907:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+9:13733:x1876607543387264:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 275us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.081916:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 83 00000100:00100000:2.0:1789672804.091344:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672804.092161:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387392 00000100:00100000:0.0:1789672804.092173:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387392 00000100:00100000:2.0:1789672804.092425:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:2.0:1789672804.092437:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+9:13733:x1876607543387392:12345-192.168.202.39@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789672804.092469:0:14405:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789672804.092498:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789672804.092502:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789672804.092505:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789672804.092507:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789672804.097755:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+9:13733:x1876607543387392:12345-192.168.202.39@tcp:256:mount.lustre.0 Request processed in 5309us (6411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.097772:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 84 00000100:00100000:0.0:1789672804.107426:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672804.107555:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387520 00000100:00100000:3.0:1789672804.107567:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387520 00000100:00100000:3.0:1789672804.107619:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 85 00000100:00100000:3.0:1789672804.107629:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+9:13733:x1876607543387520:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789672804.107661:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672804.107680:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfbce expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.107732:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.107744:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672804.107754:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c200, rc 0) 00000100:00100000:3.0:1789672804.107861:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13733:x1876607543387520:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 231us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.107868:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 85 00000100:00100000:2.0:1789672804.111728:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.111834:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387648 00000100:00100000:1.0:1789672804.111845:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387648 00000100:00100000:1.0:1789672804.111908:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 86 00000100:00100000:1.0:1789672804.111919:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13733:x1876607543387648:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789672804.112421:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13733:x1876607543387648:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 502us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.112430:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 86 00000100:00100000:2.0:1789672804.118360:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.118562:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387776 00000100:00100000:1.0:1789672804.118576:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387776 00000100:00100000:1.0:1789672804.118699:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:1.0:1789672804.118724:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13733:x1876607543387776:12345-192.168.202.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789672804.119492:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13733:x1876607543387776:12345-192.168.202.39@tcp:503:mount.lustre.0 Request processed in 778us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.119514:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 87 00000100:00100000:2.0:1789672804.124520:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.124643:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543387904 00000100:00100000:1.0:1789672804.124667:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543387904 00000100:00100000:1.0:1789672804.124741:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 88 00000100:00100000:1.0:1789672804.124753:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13756:x1876607543387904:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672804.125544:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13756:x1876607543387904:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 788us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.125557:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 88 00000100:00100000:2.0:1789672804.133907:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672804.134965:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388032 00000100:00100000:1.0:1789672804.134983:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388032 00000100:00100000:1.0:1789672804.135077:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 89 00000100:00100000:1.0:1789672804.135091:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13756:x1876607543388032:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672804.136054:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13756:x1876607543388032:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 959us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.136068:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 89 00000100:00100000:2.0:1789672804.161586:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672804.164245:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388160 00000100:00100000:3.0:1789672804.164267:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388160 00000100:00100000:3.0:1789672804.165695:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:3.0:1789672804.165708:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1876607543388160:12345-192.168.202.39@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789672804.165750:0:14412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 43b85647-7bc5-4989-9bf9-fea45033777a@192.168.202.39@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1789672804.165853:0:14412:0:(genops.c:1384:class_connect()) connect: client 43b85647-7bc5-4989-9bf9-fea45033777a, cookie 0x2247cb9491d09bc6 00000004:00100000:3.0:1789672804.165894:0:14412:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789672804.165901:0:14412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1789672804.199563:0:14412:0:(import.c:65:import_set_state_nolock()) ffff9fa639b2e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672804.199684:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+6:2356:x1876607543388160:12345-192.168.202.39@tcp:38:mount.lustre.0 Request processed in 33974us (38111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.199701:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:2.0:1789672804.203078:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672804.203130:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672804.203230:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388416 00000100:00100000:0.0:1789672804.203243:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388416 00000100:00100000:0.0:1789672804.203379:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388288 00000100:00100000:0.0:1789672804.203383:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388288 00000100:00100000:0.0:1789672804.203401:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:0.0:1789672804.203411:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+7:13733:x1876607543388416:12345-192.168.202.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789672804.203471:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789672804.203592:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+7:13733:x1876607543388416:12345-192.168.202.39@tcp:41:mount.lustre.0 Request processed in 181us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.203599:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:0.0:1789672804.203626:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672804.203664:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+6:0:x1876607543388288:12345-192.168.202.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789672804.203676:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789672804.203701:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+6:0:x1876607543388288:12345-192.168.202.39@tcp:41:mount.lustre.0 Request processed in 40us (571us total) trans 0 rc 0/0 00000100:00080000:1.0:1789672804.203964:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672804.207636:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672804.207689:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672804.207702:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789672804.208088:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388544 00000100:00100000:2.0:1789672804.208100:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388544 00000100:00100000:3.0:1789672804.208299:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:3.0:1789672804.208313:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:13733:x1876607543388544:12345-192.168.202.39@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789672804.208432:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:13733:x1876607543388544:12345-192.168.202.39@tcp:40:mount.lustre.0 Request processed in 122us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.208440:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:0.0:1789672804.208624:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:2.0:1789672804.211550:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672804.211657:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388672 00000100:00100000:3.0:1789672804.211688:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388672 00000100:00100000:3.0:1789672804.211765:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:3.0:1789672804.211776:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1876607543388672:12345-192.168.202.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789672804.212100:0:15094:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 43b85647-7bc5-4989-9bf9-fea45033777a@192.168.202.39@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1789672804.212164:0:15094:0:(genops.c:1384:class_connect()) connect: client 43b85647-7bc5-4989-9bf9-fea45033777a, cookie 0x2247cb9491d09bcd 00002000:00100000:2.0:1789672804.212181:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 43b85647-7bc5-4989-9bf9-fea45033777a/ffff9fa502560800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789672804.212196:0:15094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789672804.212983:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789672804.213030:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9fa502567800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672804.213327:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b85647-7bc5-4989-9bf9-fea45033777a+6:2356:x1876607543388672:12345-192.168.202.39@tcp:8:mount.lustre.0 Request processed in 1549us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.213339:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:2.0:1789672804.216662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672804.216730:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672804.216936:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388800 00000100:00100000:0.0:1789672804.216950:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388800 00000100:00100000:0.0:1789672804.217006:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:0.0:1789672804.217016:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1876607543388800:12345-192.168.202.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789672804.217064:0:15712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 43b85647-7bc5-4989-9bf9-fea45033777a@192.168.202.39@tcp t0 exp 0000000000000000 cur 472 last 0 00000100:00100000:1.0:1789672804.217107:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543388928 00000020:00000080:0.0:1789672804.217110:0:15712:0:(genops.c:1384:class_connect()) connect: client 43b85647-7bc5-4989-9bf9-fea45033777a, cookie 0x2247cb9491d09bd4 00000100:00100000:1.0:1789672804.217112:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543388928 00002000:00100000:0.0:1789672804.217190:0:15712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 43b85647-7bc5-4989-9bf9-fea45033777a/ffff9fa639b29000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1789672804.217194:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:1.0:1789672804.217203:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+6:13733:x1876607543388928:12345-192.168.202.39@tcp:33:mount.lustre.0 00002000:00100000:0.0:1789672804.217226:0:15712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789672804.217493:0:15712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789672804.217823:0:15712:0:(import.c:65:import_set_state_nolock()) ffff9fa639b2d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672804.218056:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+6:2356:x1876607543388800:12345-192.168.202.39@tcp:8:mount.lustre.0 Request processed in 1038us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.218066:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00000004:00080000:0.0:1789672804.219350:0:14414:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1977us 00000004:00200000:1.0:1789672804.284593:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789672804.284902:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+6:13733:x1876607543388928:12345-192.168.202.39@tcp:33:mount.lustre.0 Request processed in 67627us (68097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672804.284917:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:2.0:1789672804.532205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672804.532354:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389056 00000100:00100000:0.0:1789672804.532369:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389056 00000100:00100000:0.0:1789672804.532497:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:0.0:1789672804.532511:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+6:13777:x1876607543389056:12345-192.168.202.39@tcp:101:mkdir.0 00010000:00010000:0.0:1789672804.532540:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672804.532591:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfbf8 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672804.532702:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09be2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672804.532721:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672804.532742:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672804.532830:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789672804.532836:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672804.532886:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09be2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672804.532919:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbf8 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672804.532943:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09be2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbf8 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672804.532952:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:0.0:1789672804.532956:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672804.532960:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910e00, rc 0) 00000100:00100000:0.0:1789672804.533045:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+7:13777:x1876607543389056:12345-192.168.202.39@tcp:101:mkdir.0 Request processed in 537us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.533053:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00010000:00010000:3.0:1789672804.661601:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672804.787430:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564351104:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.787539:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672804.787622:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672804.787630:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564350976:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.787680:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672804.787738:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351104 00000100:00100000:2.0:1789672804.787748:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351104 00000100:00100000:2.0:1789672804.787845:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672804.787857:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564351104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.787932:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876607564351104:12345-0@lo:400:kworker.0 Request processed in 78us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.787941:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789672804.787972:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672804.788019:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1876607564351104:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.788066:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564350976 00000100:00100000:2.0:1789672804.788070:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564350976 00000100:00100000:2.0:1789672804.788096:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789672804.788102:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3302:x1876607564350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.788146:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3302:x1876607564350976:12345-0@lo:400:kworker.0 Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.788169:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789672804.788202:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564350976:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.788587:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564351360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.788626:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672804.788667:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672804.788674:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564351232:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.788698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672804.789506:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564351488:0@lo:400:kworker.0 00000100:00100000:0.0:1789672804.789564:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672804.789607:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672804.789615:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564351616:0@lo:400:kworker.0 00000100:00100000:0.0:1789672804.789638:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672804.789805:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564351744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672804.789841:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672804.789897:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351744 00000100:00100000:3.0:1789672804.789906:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351744 00000100:00100000:3.0:1789672804.789966:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672804.789975:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564351744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672804.790001:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672804.790054:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876607564351744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.790061:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672804.790106:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564351744:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672804.790136:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672804.790149:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351360 00000100:00100000:3.0:1789672804.790153:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351360 00000100:00100000:3.0:1789672804.790183:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351488 00000100:00100000:3.0:1789672804.790185:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351488 00000100:00100000:3.0:1789672804.790200:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351616 00000100:00100000:3.0:1789672804.790202:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351616 00000100:00100000:3.0:1789672804.790213:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789672804.790218:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672804.790249:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564351360:12345-0@lo:400:kworker.0 Request processed in 31us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.790265:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672804.790397:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351232 00000100:00100000:2.0:1789672804.790401:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351232 00000100:00100000:2.0:1789672804.790430:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672804.790437:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564351232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.790468:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1876607564351232:12345-0@lo:400:kworker.0 Request processed in 32us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.790474:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672804.790511:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564351232:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.790523:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564351360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.790749:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672804.790759:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564351488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.790818:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564351488:12345-0@lo:400:kworker.0 Request processed in 62us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.790825:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672804.790851:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564351488:0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.790872:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672804.790887:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564351616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672804.790921:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564351616:12345-0@lo:400:kworker.0 Request processed in 35us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.790927:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672804.790957:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564351616:0@lo:400:kworker.0 00000100:00080000:2.0:1789672804.790985:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789672804.938049:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 43b85647-7bc5-4989-9bf9-fea45033777a 00000001:00080000:3.0:1789672804.938257:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789672804.938308:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789672805.684996:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789672805.878008:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 43b85647-7bc5-4989-9bf9-fea45033777a 00010000:00010000:0.0:1789672806.707254:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672806.762048:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672806.762245:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389184 00000100:00100000:1.0:1789672806.762257:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389184 00000100:00100000:1.0:1789672806.762351:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:1.0:1789672806.762363:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:13829:x1876607543389184:12345-192.168.202.39@tcp:41:lfs.0 00000004:00000024:1.0:1789672806.762426:0:16286:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789672806.762524:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:13829:x1876607543389184:12345-192.168.202.39@tcp:41:lfs.0 Request processed in 162us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672806.762532:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00080000:2.0:1789672806.763615:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672806.766199:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672806.766483:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389312 00000100:00100000:3.0:1789672806.766494:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389312 00000100:00080000:2.0:1789672806.766646:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672806.769147:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:3.0:1789672806.769174:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b85647-7bc5-4989-9bf9-fea45033777a+5:13829:x1876607543389312:12345-192.168.202.39@tcp:13:lfs.0 00002000:00000024:3.0:1789672806.769214:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672806.769340:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b85647-7bc5-4989-9bf9-fea45033777a+5:13829:x1876607543389312:12345-192.168.202.39@tcp:13:lfs.0 Request processed in 179us (3152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672806.769348:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:3.0:1789672806.781846:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672806.782092:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389440 00000100:00100000:0.0:1789672806.782102:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389440 00000100:00100000:0.0:1789672806.782176:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672806.782187:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b85647-7bc5-4989-9bf9-fea45033777a+5:13829:x1876607543389440:12345-192.168.202.39@tcp:13:lfs.0 00002000:00000024:0.0:1789672806.782224:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789672806.782504:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672806.782608:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:43b85647-7bc5-4989-9bf9-fea45033777a+5:13829:x1876607543389440:12345-192.168.202.39@tcp:13:lfs.0 Request processed in 421us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672806.782616:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:2.0:1789672807.092972:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.093090:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389568 00000100:00100000:1.0:1789672807.093102:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389568 00000100:00100000:1.0:1789672807.093164:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 91 00000100:00100000:1.0:1789672807.093175:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+10:13863:x1876607543389568:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789672807.093192:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672807.093210:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d09be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfbff expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.093241:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d09be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbff expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.093252:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542ee00/0x2247cb9491d09be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbff expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.093261:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542ee00, rc 0) 00000100:00100000:1.0:1789672807.093326:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13863:x1876607543389568:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 153us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.093333:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 91 00000100:00100000:1.0:1789672807.097913:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672807.098077:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389696 00000100:00100000:2.0:1789672807.098087:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389696 00000100:00100000:2.0:1789672807.098144:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 92 00000100:00100000:2.0:1789672807.098153:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6102eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13863:x1876607543389696:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789672807.098457:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6102eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13863:x1876607543389696:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 303us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672807.098465:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 92 00000100:00100000:3.0:1789672807.100917:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672807.101150:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389824 00000100:00100000:2.0:1789672807.101160:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389824 00000100:00100000:2.0:1789672807.101222:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 93 00000100:00100000:2.0:1789672807.101232:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13863:x1876607543389824:12345-192.168.202.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789672807.101467:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13863:x1876607543389824:12345-192.168.202.39@tcp:503:mount.lustre.0 Request processed in 235us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672807.101476:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 93 00000100:00100000:3.0:1789672807.107550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.107828:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543389952 00000100:00100000:1.0:1789672807.107853:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543389952 00000100:00100000:1.0:1789672807.107916:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 94 00000100:00100000:1.0:1789672807.107926:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13869:x1876607543389952:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672807.108215:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13869:x1876607543389952:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 289us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.108224:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 94 00000100:00100000:3.0:1789672807.133851:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.134107:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390080 00000100:00100000:1.0:1789672807.134118:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390080 00000100:00100000:1.0:1789672807.134181:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 95 00000100:00100000:1.0:1789672807.134192:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13869:x1876607543390080:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672807.134613:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13869:x1876607543390080:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 420us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.134631:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 95 00000100:00100000:3.0:1789672807.142236:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672807.142524:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390208 00000100:00100000:2.0:1789672807.142534:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390208 00000100:00100000:2.0:1789672807.142599:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 96 00000100:00100000:2.0:1789672807.142609:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13863:x1876607543390208:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789672807.142637:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672807.142655:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa50333bc00/0x2247cb9491d09bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc29 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672807.142688:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa50333bc00/0x2247cb9491d09bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc29 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672807.142699:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa50333bc00/0x2247cb9491d09bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc29 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672807.142708:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333bc00, rc 0) 00000100:00100000:2.0:1789672807.142765:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13863:x1876607543390208:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 158us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672807.142772:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 96 00000100:00100000:3.0:1789672807.158779:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.158940:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390336 00000100:00100000:1.0:1789672807.158950:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390336 00000100:00100000:1.0:1789672807.159003:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 97 00000100:00100000:1.0:1789672807.159013:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13863:x1876607543390336:12345-192.168.202.39@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789672807.159041:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789672807.159066:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789672807.159070:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789672807.159073:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789672807.159075:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789672807.165263:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13863:x1876607543390336:12345-192.168.202.39@tcp:256:mount.lustre.0 Request processed in 6238us (6482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.165280:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 97 00000100:00100000:3.0:1789672807.167772:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.167948:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390464 00000100:00100000:1.0:1789672807.167964:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390464 00000100:00100000:1.0:1789672807.168017:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 98 00000100:00100000:1.0:1789672807.168026:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13863:x1876607543390464:12345-192.168.202.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789672807.168041:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672807.168059:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc30 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.168088:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.168348:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.168359:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542ea00, rc 0) 00000100:00100000:1.0:1789672807.168422:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13863:x1876607543390464:12345-192.168.202.39@tcp:101:mount.lustre.0 Request processed in 397us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.168429:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 98 00000100:00100000:3.0:1789672807.171654:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.172494:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390592 00000100:00100000:1.0:1789672807.172507:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390592 00000100:00100000:1.0:1789672807.172632:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 99 00000100:00100000:1.0:1789672807.172643:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13863:x1876607543390592:12345-192.168.202.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789672807.173009:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13863:x1876607543390592:12345-192.168.202.39@tcp:501:mount.lustre.0 Request processed in 367us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.173018:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 99 00000100:00100000:3.0:1789672807.178917:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672807.179589:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390720 00000100:00100000:2.0:1789672807.179603:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390720 00000100:00100000:2.0:1789672807.179667:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 100 00000100:00100000:2.0:1789672807.179676:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13863:x1876607543390720:12345-192.168.202.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789672807.180722:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13863:x1876607543390720:12345-192.168.202.39@tcp:503:mount.lustre.0 Request processed in 1039us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672807.180734:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 100 00000100:00100000:3.0:1789672807.185682:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672807.186390:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390848 00000100:00100000:2.0:1789672807.186400:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390848 00000100:00100000:2.0:1789672807.186479:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 101 00000100:00100000:2.0:1789672807.186489:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13875:x1876607543390848:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672807.186773:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13875:x1876607543390848:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 284us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672807.186782:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 101 00000100:00100000:3.0:1789672807.192689:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672807.192860:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543390976 00000100:00100000:0.0:1789672807.192871:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543390976 00000100:00100000:0.0:1789672807.192932:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 102 00000100:00100000:0.0:1789672807.192942:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13875:x1876607543390976:12345-192.168.202.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789672807.193206:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13875:x1876607543390976:12345-192.168.202.39@tcp:502:llog_process_th.0 Request processed in 263us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672807.193214:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 102 00000100:00100000:3.0:1789672807.206345:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672807.206396:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672807.206437:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.206718:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391104 00000100:00100000:1.0:1789672807.206729:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391104 00000100:00100000:1.0:1789672807.206771:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391488 00000100:00100000:1.0:1789672807.206777:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391488 00000100:00100000:1.0:1789672807.206870:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:1.0:1789672807.206880:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+7:2358:x1876607543391488:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672807.206962:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+7:2358:x1876607543391488:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 84us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.206970:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:1.0:1789672807.206993:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672807.206998:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1876607543391104:12345-192.168.202.39@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789672807.207023:0:14412:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 86349658-cb5b-43a4-8b32-2315a9607a2b@192.168.202.39@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:1.0:1789672807.207062:0:14412:0:(genops.c:1384:class_connect()) connect: client 86349658-cb5b-43a4-8b32-2315a9607a2b, cookie 0x2247cb9491d09bfe 00000004:00100000:1.0:1789672807.207094:0:14412:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789672807.207213:0:14412:0:(import.c:65:import_set_state_nolock()) ffff9fa63a9c3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672807.207245:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2356:x1876607543391104:12345-192.168.202.39@tcp:38:mount.lustre.0 Request processed in 246us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.207251:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:3.0:1789672807.207524:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.208067:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391616 00000100:00100000:1.0:1789672807.208076:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391616 00000100:00100000:1.0:1789672807.208973:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391744 00000100:00100000:1.0:1789672807.208980:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391744 00000100:00100000:1.0:1789672807.209019:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:1.0:1789672807.209028:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b85647-7bc5-4989-9bf9-fea45033777a+5:2358:x1876607543391616:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672807.209278:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:0.0:1789672807.209288:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2358:x1876607543391744:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672807.209320:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2358:x1876607543391744:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 35us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672807.209343:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:1.0:1789672807.211371:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43b85647-7bc5-4989-9bf9-fea45033777a+5:2358:x1876607543391616:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 69us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.211385:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:1.0:1789672807.217264:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.217352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672807.217954:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391232 00000100:00100000:3.0:1789672807.217965:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391232 00000100:00100000:3.0:1789672807.218037:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391360 00000100:00100000:3.0:1789672807.218040:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391360 00000100:00100000:3.0:1789672807.218059:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:3.0:1789672807.218068:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+7:0:x1876607543391232:12345-192.168.202.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789672807.218111:0:14412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789672807.218181:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+7:0:x1876607543391232:12345-192.168.202.39@tcp:41:mount.lustre.0 Request processed in 114us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672807.218188:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:3.0:1789672807.218204:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:3.0:1789672807.218209:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13863:x1876607543391360:12345-192.168.202.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789672807.218218:0:14412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789672807.218234:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13863:x1876607543391360:12345-192.168.202.39@tcp:41:mount.lustre.0 Request processed in 26us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672807.218240:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00080000:0.0:1789672807.219050:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672807.229275:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.229415:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543391872 00000100:00100000:1.0:1789672807.229427:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543391872 00000100:00100000:1.0:1789672807.229494:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:1.0:1789672807.229504:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13863:x1876607543391872:12345-192.168.202.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789672807.229600:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13863:x1876607543391872:12345-192.168.202.39@tcp:40:mount.lustre.0 Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.229608:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:3.0:1789672807.236693:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672807.236853:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392256 00000100:00100000:2.0:1789672807.236864:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392256 00000100:00100000:2.0:1789672807.236921:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:2.0:1789672807.236932:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13863:x1876607543392256:12345-192.168.202.39@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789672807.237014:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789672807.237225:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13863:x1876607543392256:12345-192.168.202.39@tcp:33:mount.lustre.0 Request processed in 293us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672807.237233:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:3.0:1789672807.238982:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672807.239030:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.239652:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392000 00000100:00100000:1.0:1789672807.239663:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392000 00000100:00100000:1.0:1789672807.239712:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392128 00000100:00100000:1.0:1789672807.239715:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392128 00000100:00100000:1.0:1789672807.239739:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672807.239747:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1876607543392000:12345-192.168.202.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789672807.239780:0:15712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 86349658-cb5b-43a4-8b32-2315a9607a2b@192.168.202.39@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1789672807.239867:0:15712:0:(genops.c:1384:class_connect()) connect: client 86349658-cb5b-43a4-8b32-2315a9607a2b, cookie 0x2247cb9491d09c05 00002000:00100000:1.0:1789672807.239881:0:15712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 86349658-cb5b-43a4-8b32-2315a9607a2b/ffff9fa63a9c4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789672807.239893:0:15712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789672807.240292:0:15712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789672807.240323:0:15712:0:(import.c:65:import_set_state_nolock()) ffff9fa63a9c5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672807.240388:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2356:x1876607543392000:12345-192.168.202.39@tcp:8:mount.lustre.0 Request processed in 640us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.240395:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:1.0:1789672807.240416:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:1.0:1789672807.240421:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1876607543392128:12345-192.168.202.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789672807.240436:0:15712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 86349658-cb5b-43a4-8b32-2315a9607a2b@192.168.202.39@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:1.0:1789672807.240468:0:15712:0:(genops.c:1384:class_connect()) connect: client 86349658-cb5b-43a4-8b32-2315a9607a2b, cookie 0x2247cb9491d09c0c 00002000:00100000:1.0:1789672807.240473:0:15712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 86349658-cb5b-43a4-8b32-2315a9607a2b/ffff9fa63a9c0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789672807.240494:0:15712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789672807.240644:0:15712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789672807.240662:0:15712:0:(import.c:65:import_set_state_nolock()) ffff9fa63a9c2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672807.240689:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2356:x1876607543392128:12345-192.168.202.39@tcp:8:mount.lustre.0 Request processed in 266us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.240695:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:3.0:1789672807.348016:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672807.348084:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564351872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672807.348247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672807.350092:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564351872 00000100:00100000:0.0:1789672807.350345:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564351872 00000100:00100000:0.0:1789672807.350535:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672807.350546:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564351872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672807.350576:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672807.350768:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564351872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672807.350776:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789672807.352053:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672807.357010:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564351872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672807.526222:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672807.526334:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392384 00000100:00100000:1.0:1789672807.526345:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392384 00000100:00100000:1.0:1789672807.526411:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:1.0:1789672807.526422:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+6:13896:x1876607543392384:12345-192.168.202.39@tcp:101:mkdir.0 00010000:00010000:1.0:1789672807.526442:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672807.526468:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc5a expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.526535:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.526551:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.526567:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672807.526603:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789672807.526630:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672807.526669:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.526696:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.526722:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672807.526731:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:1.0:1789672807.526733:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672807.526738:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fa00, rc 0) 00000100:00100000:1.0:1789672807.526864:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+7:13896:x1876607543392384:12345-192.168.202.39@tcp:101:mkdir.0 Request processed in 444us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672807.527110:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00010000:00010000:3.0:1789672807.732189:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672808.760233:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789672809.206319:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1789672809.468536:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 43b85647-7bc5-4989-9bf9-fea45033777a 00000001:00100000:2.0:1789672809.468562:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 86349658-cb5b-43a4-8b32-2315a9607a2b 00010000:00010000:0.0:1789672809.779129:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672809.907329:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564352000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672809.907435:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672809.911087:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564352128:0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.911194:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672809.911245:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564352640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.911278:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672809.911311:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672809.911317:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564352512:0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.911340:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672809.911369:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564352256:0@lo:400:kworker.0 00000100:00100000:3.0:1789672809.911519:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352128 00000100:00100000:3.0:1789672809.911538:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352128 00000100:00100000:3.0:1789672809.911613:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789672809.911624:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3302:x1876607564352128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672809.911694:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3302:x1876607564352128:12345-0@lo:400:kworker.0 Request processed in 71us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672809.911703:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789672809.911746:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564352384:0@lo:400:kworker.0 00000100:00100000:1.0:1789672809.913591:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352000 00000100:00100000:1.0:1789672809.913620:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352000 00000100:00100000:1.0:1789672809.913714:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672809.913727:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564352000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672809.914072:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672809.914187:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564352000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 462us (6751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672809.914194:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672809.914634:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789672809.914668:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564352000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672809.915058:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352640 00000100:00100000:2.0:1789672809.915066:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352640 00000100:00100000:2.0:1789672809.915117:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352512 00000100:00100000:2.0:1789672809.915120:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352512 00000100:00100000:2.0:1789672809.915148:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672809.915157:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564352640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.915223:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876607564352640:12345-0@lo:400:kworker.0 Request processed in 68us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672809.915230:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672809.915246:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672809.915252:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564352512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.915282:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876607564352512:12345-0@lo:400:kworker.0 Request processed in 31us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672809.915288:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789672809.915310:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672809.915316:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672809.915343:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1876607564352512:0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.915353:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564352128:0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.915364:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1876607564352640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672809.915419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672809.917927:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672809.918164:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352384 00000100:00100000:3.0:1789672809.918176:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352384 00000100:00100000:3.0:1789672809.918231:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672809.918243:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672809.918336:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876607564352384:12345-0@lo:400:kworker.0 Request processed in 95us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672809.918344:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672809.918397:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876607564352384:0@lo:400:kworker.0 00000100:00100000:1.0:1789672809.920110:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352256 00000100:00100000:1.0:1789672809.920125:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352256 00000100:00100000:1.0:1789672809.920210:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672809.920222:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564352256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672809.920343:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564352256:12345-0@lo:400:kworker.0 Request processed in 122us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672809.920350:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672809.921154:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564352256:0@lo:400:kworker.0 00000100:00080000:2.0:1789672809.921224:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789672810.022843:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86349658-cb5b-43a4-8b32-2315a9607a2b 00010000:00010000:3.0:1789672810.804500:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789672810.995356:0:16380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789672811.083480:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86349658-cb5b-43a4-8b32-2315a9607a2b 00010000:00010000:0.0:1789672811.827703:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672812.467579:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564352768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672812.467673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672812.467805:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564352768 00000100:00100000:1.0:1789672812.467814:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564352768 00000100:00100000:1.0:1789672812.467881:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672812.467892:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564352768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672812.467952:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789672812.468008:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564352768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672812.468015:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789672812.468044:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672812.468097:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564352768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672812.717709:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672812.717763:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672812.717879:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672812.717907:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672812.718110:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392512 00000100:00100000:1.0:1789672812.718130:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392512 00000100:00100000:1.0:1789672812.718189:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 104 00000100:00100000:1.0:1789672812.718199:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2360:x1876607543392512:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672812.718278:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2360:x1876607543392512:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 80us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672812.718286:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 104 00000100:00100000:0.0:1789672812.720864:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393024 00000100:00100000:0.0:1789672812.720879:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393024 00000100:00100000:0.0:1789672812.720948:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:0.0:1789672812.720958:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2360:x1876607543393024:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672812.721036:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2360:x1876607543393024:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 79us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672812.721044:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00080000:0.0:1789672812.721065:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672812.721695:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672812.721722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672812.724864:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392768 00000100:00100000:2.0:1789672812.724881:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392768 00000100:00080000:2.0:1789672812.724930:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672812.724991:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393280 00000100:00100000:2.0:1789672812.725002:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393280 00000100:00100000:2.0:1789672812.725053:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:2.0:1789672812.725065:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543392768:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672812.725153:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543392768:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 90us (7389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672812.725161:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:2.0:1789672812.725179:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:2.0:1789672812.725186:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543393280:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672812.725210:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543393280:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 25us (7303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672812.725216:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00080000:2.0:1789672812.725229:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672812.726015:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672812.726109:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392640 00000100:00100000:3.0:1789672812.726122:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392640 00000100:00100000:3.0:1789672812.726173:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:3.0:1789672812.726182:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+6:2360:x1876607543392640:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:3.0:1789672812.726232:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+6:2360:x1876607543392640:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 51us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672812.726239:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:2.0:1789672812.726678:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543392896 00000100:00100000:2.0:1789672812.726697:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543392896 00000100:00100000:2.0:1789672812.726728:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393152 00000100:00100000:2.0:1789672812.726731:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393152 00000100:00100000:2.0:1789672812.726874:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:2.0:1789672812.726883:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543392896:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672812.726921:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543392896:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 40us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672812.726928:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:2.0:1789672812.726939:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:2.0:1789672812.726945:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543393152:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672812.726964:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543393152:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 20us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672812.726980:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00080000:2.0:1789672812.726997:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672812.727000:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672812.727002:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789672812.851001:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672813.875054:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789672814.577143:0:16528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd99dc7e0 20000000:00000080:2.0:1789672814.577160:0:16528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa636cd3800 uarg=0000000000000000 20000000:01000000:2.0:1789672814.577201:0:16528:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789672814.577207:0:16528:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789672814.577212:0:16528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789672814.580098:0:16529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789672814.580198:0:16528:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789672814.589431:0:16528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789672814.589655:0:16528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590199:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09911 expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590209:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d0995e expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590216:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590226:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590234:0:16528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590241:0:16528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590290:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590325:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 12 pid: 14405 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.590341:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564352896:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672814.590515:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590525:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 12 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.590534:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353024:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672814.590584:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590594:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 18 pid: 14404 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.590605:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a54380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353152:0@lo:104: 00000100:00100000:3.0:1789672814.590639:0:16528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672814.590683:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d0995e expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.590691:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d0995e expref: 18 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.590698:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353280:0@lo:104: 00000100:00100000:3.0:1789672814.590717:0:16528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672814.590835:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353152 00000100:00100000:1.0:1789672814.590844:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353152 00000100:00100000:1.0:1789672814.590892:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672814.590902:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:16528:x1876607564353152:12345-0@lo:104: 00010000:00010000:1.0:1789672814.590916:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.590985:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789672814.590992:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:16528:x1876607564353152:12345-0@lo:104: Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672814.590998:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789672814.591015:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353280 00000100:00100000:1.0:1789672814.591018:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353280 00000100:00100000:1.0:1789672814.591032:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672814.591037:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:16528:x1876607564353280:12345-0@lo:104: 00010000:00010000:1.0:1789672814.591044:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591078:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789672814.591082:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:16528:x1876607564353280:12345-0@lo:104: Request processed in 46us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672814.591088:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789672814.591104:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672814.591110:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591116:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa60929e400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672814.591120:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591147:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672814.591154:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672814.591159:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789672814.591188:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591194:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672814.591212:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591219:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa60929e400/0x2247cb9491d09a99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09aa0 expref: -99 pid: 15816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591232:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672814.591235:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591240:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d400 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:1.0:1789672814.591243:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591249:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672814.591254:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672814.591266:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789672814.591282:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591288:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672814.591306:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591313:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa63f67d400/0x2247cb9491d0995e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09965 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.591322:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672814.591324:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672814.591326:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672814.591345:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3300:1876607564353408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672814.591376:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672814.591395:0:16528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2247cb9491d09911 expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.591406:0:16528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2247cb9491d09911 expref: 18 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.591416:0:16528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353664:0@lo:104: 00000100:00100000:1.0:1789672814.591424:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564353536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672814.591473:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672814.591542:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353408 00000100:00100000:0.0:1789672814.591560:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353408 00010000:00010000:0.0:1789672814.591583:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 19 pid: 14404 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672814.591603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672814.591692:0:16528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672814.591714:0:16528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672814.591743:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a54380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353152:0@lo:104: 00000100:00100000:3.0:1789672814.591751:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353280:0@lo:104: 00000100:00100000:3.0:1789672814.593438:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564352896:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672814.593825:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672814.593935:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353536 00000100:00100000:0.0:1789672814.593942:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353536 00010000:00010000:0.0:1789672814.593973:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0995e expref: 20 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672814.593998:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672814.594006:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+20:3300:x1876607564353408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672814.594019:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672814.594024:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 20 pid: 14404 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.594034:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 20 pid: 14404 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.594050:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929fa00/0x2247cb9491d09aa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d09a99 expref: 20 pid: 14404 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.594077:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672814.594126:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3300:x1876607564353408:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672814.594132:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672814.594148:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672814.594154:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:3301:x1876607564353536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672814.594161:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672814.594166:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d0995e expref: 18 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.594174:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d0995e expref: 18 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.594197:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542f600/0x2247cb9491d09965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d0995e expref: 18 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.594214:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672814.594241:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:3301:x1876607564353536:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672814.594248:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672814.594883:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3300:1876607564353408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672814.594926:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789672814.594939:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353664 00000100:00100000:0.0:1789672814.594943:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353664 00000100:00100000:0.0:1789672814.594971:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672814.594977:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:16528:x1876607564353664:12345-0@lo:104: 00010000:00010000:0.0:1789672814.594989:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672814.595035:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672814.595040:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+3:16528:x1876607564353664:12345-0@lo:104: Request processed in 63us (3349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672814.595046:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789672814.595190:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672814.595197:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.595205:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911c00 already unused, calling callback (ffffffffc1db8c20) 10000000:00010000:3.0:1789672814.595209:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.595216:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672814.595223:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672814.595229:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672814.595273:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.595291:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672814.595311:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.595319:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.139@tcp lock: ffff9fa61d911c00/0x2247cb9491d09911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2247cb9491d09918 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.595338:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672814.595340:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672814.595343:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672814.595370:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353024:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672814.595382:0:16528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16528:1876607564353664:0@lo:104: 00010000:00010000:3.0:1789672814.595407:0:16528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672814.595620:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672814.598022:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393408 00000100:00100000:3.0:1789672814.598037:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393408 00010000:00010000:3.0:1789672814.598087:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 13 pid: 14405 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.598123:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393536 00000100:00100000:3.0:1789672814.598126:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393536 00010000:00010000:3.0:1789672814.598137:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 14 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672814.598150:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:3.0:1789672814.598159:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639f39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+14:2358:x1876607543393408:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672814.598174:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672814.598194:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 14 pid: 14405 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.598206:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 14 pid: 14405 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.598224:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63542ea00/0x2247cb9491d09bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc30 expref: 14 pid: 14405 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.598244:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672814.598311:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639f39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2358:x1876607543393408:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 153us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672814.598320:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:3.0:1789672814.598375:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:3.0:1789672814.598382:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:2358:x1876607543393536:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672814.598390:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672814.598394:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 12 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.598403:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 12 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.598412:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09bbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbce expref: 12 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672814.598421:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672814.598440:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:2358:x1876607543393536:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 59us (2822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672814.598446:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:2.0:1789672814.599229:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564353792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672814.599289:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672814.599289:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564353536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672814.599324:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353792 00000100:00100000:1.0:1789672814.599329:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353792 00010000:00010000:1.0:1789672814.599355:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d09911 expref: 17 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672814.599376:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672814.599846:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:3302:x1876607564353792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672814.599859:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672814.599865:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2247cb9491d09911 expref: 17 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599876:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2247cb9491d09911 expref: 17 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599891:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa60929e200/0x2247cb9491d09918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2247cb9491d09911 expref: 17 pid: 14406 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599906:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599915:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599932:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599939:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599946:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599954:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599961:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67ca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672814.599965:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.599981:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.600008:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.600019:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672814.600064:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:3302:x1876607564353792:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672814.600072:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672814.600082:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3302:1876607564353792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672814.600144:0:16528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672814.600155:0:16528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672814.600162:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa63f67ca00/0x2247cb9491d09c21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672814.901908:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672815.029433:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672815.029468:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564353920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672815.029535:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672815.030383:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564353920 00000100:00100000:0.0:1789672815.030393:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564353920 00000100:00100000:0.0:1789672815.030459:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672815.030469:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564353920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672815.030505:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672815.033337:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564353920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672815.033899:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564353920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672815.033911:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789672815.034239:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672815.034849:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564354432:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.034932:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.034971:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672815.034977:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564354048:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.035053:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564354176:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035078:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.035098:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672815.035103:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564354304:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035123:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.035155:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354432 00000100:00100000:1.0:1789672815.035163:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354432 00000100:00100000:1.0:1789672815.035219:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354176 00000100:00100000:1.0:1789672815.035223:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354176 00000100:00100000:1.0:1789672815.035235:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354304 00000100:00100000:1.0:1789672815.035237:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354304 00000100:00100000:1.0:1789672815.035253:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672815.035276:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564354432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035327:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876607564354432:12345-0@lo:400:kworker.0 Request processed in 53us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.035334:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672815.035351:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789672815.035356:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564354176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035385:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876607564354176:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.035393:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789672815.035406:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789672815.035411:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564354304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035433:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564354304:12345-0@lo:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.035439:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789672815.035456:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354048 00000100:00100000:1.0:1789672815.035459:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354048 00000100:00100000:1.0:1789672815.035486:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789672815.035492:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564354048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035520:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564354048:12345-0@lo:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.035526:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789672815.035559:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672815.035563:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672815.035596:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564354304:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035606:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876607564354176:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035647:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564354048:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.035656:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1876607564354432:0@lo:400:kworker.0 00010000:00010000:2.0:1789672815.923621:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789672815.923895:0:14408:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672815.923902:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa602f4d800 from 10 10000000:01000000:1.0:1789672815.923909:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672815.923982:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.923996:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.924010:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672815.924123:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672815.924219:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.924290:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63ab56780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672815.924471:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354560 00000100:00100000:2.0:1789672815.924483:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354560 00000100:00100000:2.0:1789672815.924560:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789672815.924572:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+16:14408:x1876607564354560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672815.924588:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672815.924614:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa50333be00/0x2247cb9491d09c2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09c28 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.924645:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa50333be00/0x2247cb9491d09c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09c28 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.924658:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa50333be00/0x2247cb9491d09c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09c28 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.924668:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333be00, rc 0) 00000100:00100000:2.0:1789672815.924742:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:14408:x1876607564354560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.924749:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789672815.924875:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672815.924893:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c2f expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672815.924903:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09c2f expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672815.924993:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672815.925091:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672815.925118:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a767000 going to sleep for 11 seconds 00000100:00100000:1.0:1789672815.925186:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354688 00000100:00100000:1.0:1789672815.925191:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354688 00000100:00100000:1.0:1789672815.925224:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789672815.925230:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa603ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:14408:x1876607564354688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672815.925930:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa603ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:14408:x1876607564354688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 696us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.925941:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789672815.930355:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.930452:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa50346ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.930572:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.930631:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6330ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672815.931895:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354816 00000100:00100000:3.0:1789672815.931911:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354816 00000100:00100000:3.0:1789672815.931989:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789672815.932002:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:14408:x1876607564354816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672815.933142:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:14408:x1876607564354816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1139us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672815.933155:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789672815.934222:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa50346ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789672815.935405:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789672815.935640:0:14408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789672815.935662:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672815.935682:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c2f expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.935695:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542f600/0x2247cb9491d09c28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c2f expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672815.935776:0:14408:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672815.935780:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa63f8cd800 from 10 10000000:01000000:1.0:1789672815.936078:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672815.936128:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.936139:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.936157:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672815.936188:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672815.936272:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.936368:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63ab56240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672815.936415:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564354944 00000100:00100000:2.0:1789672815.936424:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564354944 00000100:00100000:2.0:1789672815.936519:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789672815.936531:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+17:14408:x1876607564354944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672815.936555:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672815.936571:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa50333a400/0x2247cb9491d09c3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09c36 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.936601:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa50333a400/0x2247cb9491d09c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09c36 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.936613:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa50333a400/0x2247cb9491d09c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09c36 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.936631:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333a400, rc 0) 00000100:00100000:2.0:1789672815.936692:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564354944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.936700:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672815.936849:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564354944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672815.936867:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c3d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672815.936877:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09c3d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672815.936934:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672815.936963:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672815.936989:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789672815.937130:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564355072 00000100:00100000:2.0:1789672815.937135:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564355072 00000100:00100000:2.0:1789672815.937457:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789672815.937466:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564355072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.938446:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564355072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 976us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.938458:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789672815.939579:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.939656:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.939908:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.940068:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa6082b2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672815.940157:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564355200 00000100:00100000:1.0:1789672815.940167:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564355200 00000100:00100000:1.0:1789672815.940227:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789672815.940237:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564355200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672815.940462:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564355200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.940471:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789672815.940571:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789672815.942288:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789672815.942497:0:14408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789672815.942547:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672815.942561:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c3d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.942574:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542e400/0x2247cb9491d09c36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c3d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672815.942588:0:14408:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672815.942591:0:14408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa6186e7800 from 10 10000000:01000000:1.0:1789672815.942594:0:14408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672815.942638:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.942647:0:14408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672815.942660:0:14408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672815.942686:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672815.942935:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.943139:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa63ab56480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672815.943192:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564355328 00000100:00100000:2.0:1789672815.943201:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564355328 00000100:00100000:2.0:1789672815.943301:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789672815.943312:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+18:14408:x1876607564355328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672815.943329:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672815.943345:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa50333b600/0x2247cb9491d09c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2247cb9491d09c44 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.943390:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa50333b600/0x2247cb9491d09c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2247cb9491d09c44 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.943401:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa50333b600/0x2247cb9491d09c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2247cb9491d09c44 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.943410:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333b600, rc 0) 00000100:00100000:2.0:1789672815.943462:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564355328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.943470:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789672815.943579:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672815.943596:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c4b expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.943606:0:14408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2247cb9491d09c4b expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672815.943672:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.943702:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.943936:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa603afc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672815.944109:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564355456 00000100:00100000:1.0:1789672815.944117:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564355456 00000100:00100000:1.0:1789672815.944191:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672815.944200:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564355456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672815.944570:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564355456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.944577:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789672815.944757:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.944826:0:14408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.944880:0:14408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944906:0:14408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa603afc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672815.944920:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564355584 00000100:00100000:2.0:1789672815.944931:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564355584 00000100:00100000:2.0:1789672815.945268:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789672815.945276:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564355584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672815.945473:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:14408:x1876607564355584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.945481:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789672815.945527:0:14408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503468380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:14408:1876607564355584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789672815.947305:0:16589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789672815.947398:0:14408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789672815.947424:0:14408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672815.947436:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c4b expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672815.947449:0:14408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.139@tcp lock: ffff9fa63542e800/0x2247cb9491d09c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2247cb9491d09c4b expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672816.553438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672816.553635:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393664 00000100:00100000:2.0:1789672816.553649:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393664 00000100:00100000:2.0:1789672816.553726:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:2.0:1789672816.553738:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+11:13747:x1876607543393664:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672816.553761:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672816.553823:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa50333ba00/0x2247cb9491d09c52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc61 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672816.553863:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa50333ba00/0x2247cb9491d09c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc61 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672816.553875:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa50333ba00/0x2247cb9491d09c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc61 expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672816.553905:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333ba00, rc 0) 00000100:00100000:2.0:1789672816.553974:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13747:x1876607543393664:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 238us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672816.553982:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 114 00000100:00100000:0.0:1789672816.558302:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672816.558400:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393792 00000100:00100000:3.0:1789672816.558413:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393792 00000100:00100000:3.0:1789672816.558486:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:3.0:1789672816.558497:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13747:x1876607543393792:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672816.559423:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13747:x1876607543393792:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 922us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672816.559434:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 115 00000100:00100000:0.0:1789672816.566286:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672816.567032:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543393920 00000100:00100000:3.0:1789672816.567047:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543393920 00000100:00100000:3.0:1789672816.567111:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 116 00000100:00100000:3.0:1789672816.567124:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13747:x1876607543393920:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672816.568514:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13747:x1876607543393920:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 1383us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672816.568528:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 116 00000100:00100000:0.0:1789672816.587396:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672816.587572:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394048 00000100:00100000:3.0:1789672816.587587:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394048 00000100:00100000:3.0:1789672816.596844:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 117 00000100:00100000:3.0:1789672816.596871:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+12:13747:x1876607543394048:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672816.596897:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672816.596921:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09c59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc68 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672816.596959:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc68 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672816.596971:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa63f67c200/0x2247cb9491d09c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc68 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672816.596981:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c200, rc 0) 00000100:00100000:3.0:1789672816.597192:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13747:x1876607543394048:12345-192.168.202.39@tcp:101:ll_cfg_requeue.0 Request processed in 331us (9809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672816.597210:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 117 00000100:00100000:0.0:1789672816.599429:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672816.601469:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394176 00000100:00100000:3.0:1789672816.601489:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394176 00000100:00100000:3.0:1789672816.601575:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 118 00000100:00100000:3.0:1789672816.601588:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13747:x1876607543394176:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672816.602015:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13747:x1876607543394176:12345-192.168.202.39@tcp:501:ll_cfg_requeue.0 Request processed in 429us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672816.602025:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 118 00000100:00100000:2.0:1789672816.608158:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672816.608296:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394304 00000100:00100000:1.0:1789672816.608324:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394304 00000100:00100000:1.0:1789672816.608396:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 119 00000100:00100000:1.0:1789672816.608409:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13747:x1876607543394304:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672816.608745:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:13747:x1876607543394304:12345-192.168.202.39@tcp:503:ll_cfg_requeue.0 Request processed in 337us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672816.608754:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 119 00010000:00010000:3.0:1789672816.950997:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672817.588232:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564355712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672817.588331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672817.588706:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564355712 00000100:00100000:0.0:1789672817.588718:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564355712 00000100:00100000:0.0:1789672817.588893:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672817.588905:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564355712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672817.588952:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789672817.589086:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564355712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672817.589095:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789672817.589228:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564355712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789672817.589355:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672817.850541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672817.850601:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672817.850733:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394432 00000100:00100000:0.0:1789672817.850764:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394432 00000100:00100000:0.0:1789672817.850882:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:0.0:1789672817.850895:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2359:x1876607543394432:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672817.850993:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2359:x1876607543394432:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 101us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672817.851002:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 120 00000100:00100000:3.0:1789672817.851933:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394560 00000100:00100000:3.0:1789672817.851944:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394560 00000100:00100000:3.0:1789672817.852018:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:3.0:1789672817.852027:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+6:2359:x1876607543394560:12345-192.168.202.39@tcp:400:kworker.0 00000100:00080000:1.0:1789672817.852240:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672817.852327:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+6:2359:x1876607543394560:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 301us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672817.852335:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:2.0:1789672817.862544:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672817.862738:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672817.862762:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672817.862829:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672817.862859:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672817.862921:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394944 00000100:00100000:2.0:1789672817.862934:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394944 00000100:00100000:2.0:1789672817.863009:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:2.0:1789672817.863019:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2360:x1876607543394944:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672817.863136:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2360:x1876607543394944:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672817.863144:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:2.0:1789672817.863171:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394816 00000100:00100000:2.0:1789672817.863175:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394816 00000100:00100000:2.0:1789672817.863196:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395072 00000100:00100000:2.0:1789672817.863199:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395072 00000100:00100000:2.0:1789672817.863212:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543394688 00000100:00100000:2.0:1789672817.863214:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543394688 00000100:00100000:2.0:1789672817.863225:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395200 00000100:00100000:2.0:1789672817.863227:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395200 00000100:00100000:2.0:1789672817.863240:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:2.0:1789672817.863246:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543394816:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672817.863291:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543394816:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 45us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672817.863297:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:2.0:1789672817.863310:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:2.0:1789672817.863316:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543395072:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672817.863343:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543395072:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672817.863349:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:2.0:1789672817.863360:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:2.0:1789672817.863366:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543394688:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672817.863387:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2360:x1876607543394688:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 21us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672817.863393:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:2.0:1789672817.863404:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:2.0:1789672817.863410:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543395200:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672817.863431:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2360:x1876607543395200:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672817.863438:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00080000:2.0:1789672817.863556:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672817.863561:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672817.863564:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789672817.971232:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672818.237692:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672818.237838:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395328 00000100:00100000:3.0:1789672818.237861:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395328 00000100:00100000:3.0:1789672818.237943:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:3.0:1789672818.237955:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+6:14406:x1876607543395328:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672818.237982:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672818.238035:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc6f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238137:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238156:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238176:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238195:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238204:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238211:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238626:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09c75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238637:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09c75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238645:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09c75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672818.238677:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789672818.238682:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672818.238728:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09c75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238747:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238754:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238762:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238769:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672818.238774:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238783:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238842:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:3.0:1789672818.238846:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672818.238853:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238860:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238874:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238880:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238886:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238897:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67de00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672818.238901:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238907:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238915:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fa611330900) 00010000:00010000:3.0:1789672818.238917:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672818.238920:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238926:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09c6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238967:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc6f expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238983:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d800/0x2247cb9491d09c75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc6f expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.238990:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa611330600) 00010000:00010000:3.0:1789672818.238992:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672818.238994:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67d800, rc 0) 00000100:00100000:3.0:1789672818.239085:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+7:14406:x1876607543395328:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1130us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672818.239094:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:2.0:1789672818.241737:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.241930:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395584 00000100:00100000:1.0:1789672818.241944:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395584 00000100:00100000:1.0:1789672818.242024:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:1.0:1789672818.242036:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:14406:x1876607543395584:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672818.242072:0:16286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672818.242099:0:16286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09c7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc76 expref: -99 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.243342:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.243370:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.243382:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.245200:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.245224:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.245237:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.245642:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d09c91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.245652:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d09c91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.245660:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d09c91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672818.245671:0:16286:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789672818.248823:0:16286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249057:0:16286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249066:0:16286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249071:0:16286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542ea00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672818.249146:0:16286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249175:0:16286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249194:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa611330600) 00010000:00010000:1.0:1789672818.249197:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672818.249203:0:16286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249210:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09c83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249230:0:16286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249236:0:16286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249242:0:16286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249247:0:16286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672818.249249:0:16286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249255:0:16286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249263:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa6184b6c00) 00010000:00010000:1.0:1789672818.249266:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672818.249268:0:16286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249284:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09c8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249944:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09c7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc76 expref: 10 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249966:0:16286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f200/0x2247cb9491d09c91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc76 expref: 9 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.249974:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6200) 00010000:00010000:1.0:1789672818.249976:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672818.249978:0:16286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542f200, rc 0) 00000100:00100000:1.0:1789672818.251447:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+9:14406:x1876607543395584:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 9401us (9712us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789672818.251460:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:2.0:1789672818.260952:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672818.261151:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395712 00000100:00100000:3.0:1789672818.261190:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395712 00000100:00100000:3.0:1789672818.261283:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:3.0:1789672818.261296:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+9:14406:x1876607543395712:12345-192.168.202.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789672818.261533:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+9:14406:x1876607543395712:12345-192.168.202.39@tcp:59:lhsmtool_posix.0 Request processed in 238us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672818.261544:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:0.0:1789672818.286556:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672818.286666:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395840 00000100:00100000:2.0:1789672818.286717:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395840 00000100:00100000:2.0:1789672818.286826:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:2.0:1789672818.286841:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+9:14412:x1876607543395840:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672818.286871:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672818.286902:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ae00/0x2247cb9491d09c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc7d expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287008:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287027:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287039:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287052:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287057:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287061:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287278:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287284:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287288:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287297:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.287302:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287308:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287318:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:2.0:1789672818.287320:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.287325:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287330:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287340:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287343:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287347:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287350:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.287352:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287355:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287366:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa611f22600) 00010000:00010000:2.0:1789672818.287367:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.287369:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287373:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287402:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ae00/0x2247cb9491d09c9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc7d expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287409:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:2.0:1789672818.287410:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.287412:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ae00/0x2247cb9491d09c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc7d expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.287419:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333ae00, rc 0) 00000100:00100000:2.0:1789672818.287497:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+9:14412:x1876607543395840:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 660us (957us total) trans 0 rc 301/301 00000100:00100000:2.0:1789672818.287503:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:2.0:1789672818.292422:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.292711:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543395968 00000100:00100000:1.0:1789672818.292726:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543395968 00000100:00100000:1.0:1789672818.292918:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:1.0:1789672818.292932:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:43b85647-7bc5-4989-9bf9-fea45033777a+9:14412:x1876607543395968:12345-192.168.202.39@tcp:700:lfs.0 00000100:00100000:1.0:1789672818.293037:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:43b85647-7bc5-4989-9bf9-fea45033777a+9:14412:x1876607543395968:12345-192.168.202.39@tcp:700:lfs.0 Request processed in 109us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672818.293045:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:0.0:1789672818.300176:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.300978:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543396224 00000100:00100000:1.0:1789672818.301006:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543396224 00000100:00100000:1.0:1789672818.301092:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:1.0:1789672818.301105:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+9:14412:x1876607543396224:12345-192.168.202.39@tcp:36:lfs.0 00010000:00010000:1.0:1789672818.301204:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672818.301242:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910e00/0x2247cb9491d09be2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfbf8 expref: 9 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.301267:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:1.0:1789672818.301273:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672818.301562:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.301579:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 5 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.301589:0:14412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.301632:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 5 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.301648:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 5 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672818.301664:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14412:1876607564355840:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672818.302236:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa503236840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672818.305262:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672818.305366:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543396352 00000100:00100000:3.0:1789672818.305380:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543396352 00010000:00010000:3.0:1789672818.305431:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 6 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672818.305480:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:3.0:1789672818.305492:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2358:x1876607543396352:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672818.305512:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672818.305529:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 6 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.305545:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 6 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.305572:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:3.0:1789672818.305579:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.305590:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.305598:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.305642:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672818.305722:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2358:x1876607543396352:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 232us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672818.305731:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00010000:00010000:1.0:1789672818.306264:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09c1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc5a expref: 5 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672818.306299:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63f782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14412:1876607564355840:192.168.202.39@tcp:104: 00010000:00010000:1.0:1789672818.306326:0:14412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.306344:0:14412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.306350:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.306380:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.306391:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.306400:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672818.309438:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789672818.309462:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.309475:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.309485:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.309492:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672818.309497:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.309507:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.309549:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa610c05400) 00010000:00010000:1.0:1789672818.309553:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672818.309560:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.309567:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cb4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672818.309601:0:14412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002804ba7a reply state 00000000eacbcd76 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672818.309612:0:14412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672818.309736:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+10:14412:x1876607543396224:12345-192.168.202.39@tcp:36:lfs.0 Request processed in 8628us (9571us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789672818.309746:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00010000:00010000:3.0:1789672818.317721:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.317744:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.317754:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.317760:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672818.317765:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.317774:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.317837:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa6184b6c00) 00010000:00010000:3.0:1789672818.317840:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672818.317847:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.317853:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09cbb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672818.382580:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.382901:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543396480 00000100:00100000:1.0:1789672818.382915:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543396480 00000100:00100000:1.0:1789672818.383005:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:1.0:1789672818.383027:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+9:14420:x1876607543396480:12345-192.168.202.39@tcp:101:lctl.0 00010000:00010000:1.0:1789672818.383059:0:16286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672818.383089:0:16286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc84 expref: -99 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.383178:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09cc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.383196:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.383235:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672818.383280:0:16286:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789672818.383285:0:16286:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672818.383334:0:16286:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.383381:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc84 expref: 11 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.383413:0:16286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542fa00/0x2247cb9491d09cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc84 expref: 10 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.383422:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:1.0:1789672818.383425:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672818.383429:0:16286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542fa00, rc 0) 00000100:00100000:1.0:1789672818.384150:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+10:14420:x1876607543396480:12345-192.168.202.39@tcp:101:lctl.0 Request processed in 1128us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672818.384162:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:0.0:1789672818.411680:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672818.412222:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543396608 00000100:00100000:3.0:1789672818.412238:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543396608 00000100:00100000:3.0:1789672818.412375:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:3.0:1789672818.412389:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+5:14421:x1876607543396608:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:3.0:1789672818.412421:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672818.412451:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc8b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.412554:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.412573:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.412588:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672818.412636:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789672818.412641:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789672818.412673:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.412874:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc8b expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.412898:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67de00/0x2247cb9491d09cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc8b expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.412909:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:3.0:1789672818.412912:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672818.412916:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67de00, rc 0) 00000100:00100000:3.0:1789672818.413011:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+6:14421:x1876607543396608:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 625us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672818.413028:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 21 00000100:00100000:3.0:1789672818.417948:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672818.418120:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543396736 00000100:00100000:2.0:1789672818.418134:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543396736 00000100:00100000:2.0:1789672818.418273:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 22 00000100:00100000:2.0:1789672818.418286:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+6:14421:x1876607543396736:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:2.0:1789672818.418312:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672818.418338:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ae00/0x2247cb9491d09cde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc92 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418524:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418543:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418559:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418577:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418584:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418591:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418910:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09cf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418935:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.418949:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672818.418994:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789672818.418999:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672818.419026:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.419061:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.419070:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.419080:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.419089:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.419095:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.419106:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420281:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:2.0:1789672818.420291:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.420297:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420307:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420326:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420333:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420340:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420359:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.420363:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420370:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420379:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa611f22600) 00010000:00010000:2.0:1789672818.420381:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.420384:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420390:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09cec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420443:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ae00/0x2247cb9491d09cde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc92 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420460:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc92 expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.420467:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa611f22700) 00010000:00010000:2.0:1789672818.420470:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672818.420472:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333a600, rc 0) 00000100:00100000:2.0:1789672818.421351:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+7:14421:x1876607543396736:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 3063us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672818.421361:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 22 00000040:00080000:0.0:1789672818.422873:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789672818.430694:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.430982:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543396992 00000100:00100000:1.0:1789672818.430992:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543396992 00000100:00100000:0.0:1789672818.431180:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:0.0:1789672818.431191:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+7:14421:x1876607543396992:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672818.431212:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672818.431234:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d09cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfc99 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672818.431331:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789672818.431457:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d09cfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc99 expref: 9 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.431471:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:0.0:1789672818.431474:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672818.431480:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911000/0x2247cb9491d09cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc99 expref: 9 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.431706:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911000, rc 0) 00000100:00100000:0.0:1789672818.431828:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+8:14421:x1876607543396992:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 638us (1144us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789672818.431836:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 23 00000100:00100000:1.0:1789672818.437239:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672818.437544:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543397248 00000100:00100000:2.0:1789672818.437564:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543397248 00000100:00100000:2.0:1789672818.437663:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 24 00000100:00100000:2.0:1789672818.437675:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+8:14421:x1876607543397248:12345-192.168.202.39@tcp:36:lfs.0 00010000:00010000:2.0:1789672818.437739:0:16286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672818.437764:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09cf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfc92 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.437782:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa611f22700) 00010000:00010000:2.0:1789672818.437827:0:16286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672818.437853:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.437866:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.437877:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672818.438093:0:16286:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057fd0930 reply state 00000000e2c1c87d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672818.438103:0:16286:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789672818.438112:0:16286:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789672818.438205:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86349658-cb5b-43a4-8b32-2315a9607a2b+9:14421:x1876607543397248:12345-192.168.202.39@tcp:36:lfs.0 Request processed in 532us (975us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789672818.438213:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 24 00010000:00010000:0.0:1789672818.442913:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.442934:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.442943:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.442949:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672818.442955:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.442964:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.442983:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa611f22600) 00010000:00010000:0.0:1789672818.442986:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789672818.442992:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.442999:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09d08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672818.445584:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.445676:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543397504 00000100:00100000:0.0:1789672818.445700:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543397504 00000100:00100000:0.0:1789672818.445776:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:0.0:1789672818.445820:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+8:14421:x1876607543397504:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672818.446056:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+9:14421:x1876607543397504:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 271us (481us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789672818.446064:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:3.0:1789672818.454946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.460109:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543397760 00000100:00100000:1.0:1789672818.460135:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543397760 00000100:00100000:1.0:1789672818.460212:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:1.0:1789672818.460222:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+9:14421:x1876607543397760:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672818.460264:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672818.460284:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfca0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.460361:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.460375:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.460387:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.460401:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.460408:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.460414:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672818.460543:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789672818.461024:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461034:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461041:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461058:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542e600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672818.461062:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461069:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461080:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:1.0:1789672818.461082:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672818.461087:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461093:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542e600/0x2247cb9491d09d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461107:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461112:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461118:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461183:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63542f800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672818.461186:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461192:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461208:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa6184b6500) 00010000:00010000:1.0:1789672818.461211:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672818.461214:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461219:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542f800/0x2247cb9491d09d1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461267:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09d0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca0 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461276:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:1.0:1789672818.461278:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672818.461282:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63542ea00/0x2247cb9491d09d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca0 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.461292:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63542ea00, rc 0) 00000100:00100000:1.0:1789672818.461364:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+10:14421:x1876607543397760:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1143us (7665us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789672818.461372:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 25 00000100:00100000:3.0:1789672818.465971:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.466072:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543397888 00000100:00100000:1.0:1789672818.466083:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543397888 00000100:00100000:1.0:1789672818.466154:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:1.0:1789672818.466165:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+10:14421:x1876607543397888:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:1.0:1789672818.466191:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672818.466217:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044200/0x2247cb9491d09d2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfca7 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.466618:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.466633:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.466714:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672818.466752:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789672818.466755:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789672818.466773:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.469009:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044200/0x2247cb9491d09d2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.469035:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672818.469044:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:1.0:1789672818.469048:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672818.469051:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044800, rc 0) 00000100:00100000:0.0:1789672818.470891:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+11:14421:x1876607543397888:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 4718us (4920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672818.470904:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 26 00000100:00100000:0.0:1789672818.474573:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672818.474685:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543398016 00000100:00100000:2.0:1789672818.474696:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543398016 00000100:00100000:2.0:1789672818.474772:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:2.0:1789672818.474812:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+11:14421:x1876607543398016:12345-192.168.202.39@tcp:37:lfs.0 00000100:00100000:2.0:1789672818.485748:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+11:14421:x1876607543398016:12345-192.168.202.39@tcp:37:lfs.0 Request processed in 10948us (11167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672818.485761:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:3.0:1789672818.489057:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.489171:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543398272 00000100:00100000:1.0:1789672818.489183:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543398272 00000100:00100000:1.0:1789672818.489249:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:1.0:1789672818.489259:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61068f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+11:14421:x1876607543398272:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:1.0:1789672818.489495:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61068f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86349658-cb5b-43a4-8b32-2315a9607a2b+12:14421:x1876607543398272:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 237us (447us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789672818.489531:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:0.0:1789672818.547714:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672818.547880:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543398400 00000100:00100000:2.0:1789672818.547890:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543398400 00000100:00100000:2.0:1789672818.547952:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:2.0:1789672818.547963:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+10:14427:x1876607543398400:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672818.547983:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672818.548002:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcae expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548068:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548082:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548094:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548107:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548114:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548120:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548216:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a200/0x2247cb9491d09d4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548238:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a200/0x2247cb9491d09d4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548246:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a200/0x2247cb9491d09d4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672818.548275:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789672818.548279:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672818.548316:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a200/0x2247cb9491d09d4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548328:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548334:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548340:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548346:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.548351:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548358:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548369:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:2.0:1789672818.548372:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.548377:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548392:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b800/0x2247cb9491d09d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548408:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548414:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548420:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548425:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333aa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.548427:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548434:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548441:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa611f22700) 00010000:00010000:2.0:1789672818.548444:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.548447:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548453:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548482:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcae expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548508:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a200/0x2247cb9491d09d4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcae expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.548527:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:2.0:1789672818.548529:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789672818.548532:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333a200, rc 0) 00000100:00100000:2.0:1789672818.548596:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+11:14427:x1876607543398400:12345-192.168.202.39@tcp:101:bash.0 Request processed in 635us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672818.548604:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 27 00000100:00100000:3.0:1789672818.551659:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672818.551757:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543398656 00000100:00100000:2.0:1789672818.551768:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543398656 00000100:00100000:2.0:1789672818.551869:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 28 00000100:00100000:2.0:1789672818.551880:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+11:14427:x1876607543398656:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:2.0:1789672818.551900:0:16286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672818.551921:0:16286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09d55 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcb5 expref: -99 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.552038:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.552054:0:16286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.552063:0:16286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.552100:0:16286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.552127:0:16286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 11 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672818.552143:0:16286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa503469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16286:1876607564355968:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672818.552248:0:16286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604f43600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672818.558260:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.558662:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543398784 00000100:00100000:0.0:1789672818.558673:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543398784 00010000:00010000:0.0:1789672818.558726:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 12 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672818.558761:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:0.0:1789672818.558770:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+12:2357:x1876607543398784:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672818.558823:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672818.558831:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 12 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.558845:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 12 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.558867:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672818.558872:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.558893:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.558901:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.558920:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672818.558979:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+12:2357:x1876607543398784:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 209us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672818.558986:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00010000:00010000:2.0:1789672818.562392:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09d32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfca7 expref: 11 pid: 14411 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672818.562418:0:16286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa503469880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16286:1876607564355968:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672818.562443:0:16286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.562453:0:16286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.562459:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.562486:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.562497:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.562506:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566087:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566119:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566132:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672818.566146:0:16286:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789672818.566178:0:16286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566185:0:16286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566192:0:16286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566198:0:16286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.566202:0:16286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566209:0:16286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566222:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:2.0:1789672818.566225:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.566230:0:16286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566414:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09d5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672818.566435:0:16286:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca41d20c reply state 0000000066af3ae7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672818.566451:0:16286:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789672818.566491:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09d55 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 14 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566507:0:16286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 13 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.566597:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672818.566600:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789672818.566602:0:16286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333aa00, rc 0) 00000100:00100000:2.0:1789672818.566686:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+14:14427:x1876607543398656:12345-192.168.202.39@tcp:101:bash.0 Request processed in 14807us (15035us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789672818.566704:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 28 00010000:00010000:2.0:1789672818.584954:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.584974:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.584983:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.584989:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333a600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672818.584994:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.585001:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.585035:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fa611f22700) 00010000:00010000:2.0:1789672818.585039:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672818.585044:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672818.585050:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a600/0x2247cb9491d09d63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672818.585248:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.585634:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543398912 00000100:00100000:0.0:1789672818.585645:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543398912 00000100:00100000:0.0:1789672818.585717:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:0.0:1789672818.585727:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+13:14427:x1876607543398912:12345-192.168.202.39@tcp:101:bash.0 00010000:00010000:0.0:1789672818.585750:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672818.585768:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcbc expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.585862:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.585876:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.585887:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672818.585925:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789672818.585930:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789672818.585961:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.585971:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.585994:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.586009:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.586015:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672818.586018:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672818.586020:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910600, rc 0) 00000100:00100000:0.0:1789672818.586072:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+14:14427:x1876607543398912:12345-192.168.202.39@tcp:101:bash.0 Request processed in 347us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672818.586078:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 29 00000100:00100000:0.0:1789672818.601761:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.601995:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543399168 00000100:00100000:1.0:1789672818.602007:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543399168 00000100:00100000:1.0:1789672818.602067:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:1.0:1789672818.602077:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+14:14427:x1876607543399168:12345-192.168.202.39@tcp:35:bash.0 00000100:00100000:1.0:1789672818.602471:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+15:14427:x1876607543399168:12345-192.168.202.39@tcp:35:bash.0 Request processed in 393us (716us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789672818.602479:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:1.0:1789672818.734856:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.734953:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543399424 00000100:00100000:0.0:1789672818.734965:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543399424 00000100:00100000:0.0:1789672818.735077:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:0.0:1789672818.735089:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+15:14437:x1876607543399424:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672818.735114:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672818.735348:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcc3 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672818.735444:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789672818.735708:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcc3 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.735736:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa6184b6e00) 00010000:00010000:0.0:1789672818.735739:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672818.735745:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcc3 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.735759:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672818.735918:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+16:14437:x1876607543399424:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 830us (1069us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789672818.735925:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:1.0:1789672818.746463:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.748921:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543399680 00000100:00100000:0.0:1789672818.748936:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543399680 00000100:00100000:0.0:1789672818.749003:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:0.0:1789672818.749014:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+16:14437:x1876607543399680:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672818.750646:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+17:14437:x1876607543399680:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 1616us (4176us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789672818.750659:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:3.0:1789672818.845025:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.845135:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543399936 00000100:00100000:0.0:1789672818.845152:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543399936 00000100:00100000:0.0:1789672818.845234:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:0.0:1789672818.845245:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+17:14440:x1876607543399936:12345-192.168.202.39@tcp:101:lfs.0 00010000:00010000:0.0:1789672818.845269:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672818.845291:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcca expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.845395:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09d9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.845422:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.845434:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09d9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672818.845446:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789672818.846114:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09d94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcca expref: 20 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.846149:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09d9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcca expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.846157:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672818.846160:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672818.846164:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d911a00, rc 0) 00000100:00100000:0.0:1789672818.846315:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+19:14440:x1876607543399936:12345-192.168.202.39@tcp:101:lfs.0 Request processed in 1069us (1304us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789672818.846323:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:1.0:1789672818.870983:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672818.871020:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.871140:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543400192 00000100:00100000:0.0:1789672818.871150:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543400192 00000100:00100000:0.0:1789672818.871220:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:0.0:1789672818.871230:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b85647-7bc5-4989-9bf9-fea45033777a+19:2357:x1876607543400192:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672818.871246:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672818.871269:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09d9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcca expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672818.871305:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672818.871310:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672818.871361:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b85647-7bc5-4989-9bf9-fea45033777a+18:2357:x1876607543400192:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 132us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672818.871369:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:3.0:1789672818.872251:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543400064 00000100:00100000:3.0:1789672818.872261:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543400064 00000100:00100000:3.0:1789672818.872307:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:3.0:1789672818.872316:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+18:14440:x1876607543400064:12345-192.168.202.39@tcp:54:lfs.0 00010000:00010000:3.0:1789672818.872456:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872473:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872484:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872529:0:16286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872537:0:16286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872544:0:16286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872564:0:16286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67c400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:3.0:1789672818.872569:0:16286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872578:0:16286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872589:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:3.0:1789672818.872592:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672818.872597:0:16286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672818.872602:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09da9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672818.872928:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+18:14440:x1876607543400064:12345-192.168.202.39@tcp:54:lfs.0 Request processed in 611us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672818.872936:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 32 00000100:00100000:2.0:1789672818.876610:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672818.876686:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543400448 00000100:00100000:0.0:1789672818.876704:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543400448 00000100:00100000:0.0:1789672818.876806:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:0.0:1789672818.876819:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b85647-7bc5-4989-9bf9-fea45033777a+18:14440:x1876607543400448:12345-192.168.202.39@tcp:35:lfs.0 00000100:00100000:0.0:1789672818.877077:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b85647-7bc5-4989-9bf9-fea45033777a+19:14440:x1876607543400448:12345-192.168.202.39@tcp:35:lfs.0 Request processed in 261us (482us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789672818.877085:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00010000:00010000:2.0:1789672818.995064:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672819.144254:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.144364:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543400704 00000100:00100000:0.0:1789672819.144377:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543400704 00000100:00100000:0.0:1789672819.144529:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00100000:0.0:1789672819.144540:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+19:14471:x1876607543400704:12345-192.168.202.39@tcp:101:cat.0 00010000:00010000:0.0:1789672819.144567:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672819.144589:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09db0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcd1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.144699:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09db7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.144714:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09db7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.144752:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09db7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672819.144769:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789672819.145127:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09db0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcd1 expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.145144:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09db7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcd1 expref: 21 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.145151:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.145154:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672819.145157:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672819.145256:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+21:14471:x1876607543400704:12345-192.168.202.39@tcp:101:cat.0 Request processed in 720us (1018us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789672819.145262:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 33 00000100:00080000:2.0:1789672819.146522:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672819.151127:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672819.151207:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.151285:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543401088 00000100:00100000:2.0:1789672819.151297:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543401088 00000100:00100000:2.0:1789672819.151356:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:2.0:1789672819.151366:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b85647-7bc5-4989-9bf9-fea45033777a+21:14471:x1876607543401088:12345-192.168.202.39@tcp:35:cat.0 00000100:00100000:0.0:1789672819.151547:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543400832 00000100:00100000:0.0:1789672819.151553:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543400832 00000100:00100000:0.0:1789672819.151601:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:0.0:1789672819.151609:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b85647-7bc5-4989-9bf9-fea45033777a+22:2357:x1876607543400832:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672819.151622:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672819.151650:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09db7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcd1 expref: 23 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.151672:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.151678:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672819.152088:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b85647-7bc5-4989-9bf9-fea45033777a+22:2357:x1876607543400832:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 477us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.152098:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:2.0:1789672819.152108:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43b85647-7bc5-4989-9bf9-fea45033777a+22:14471:x1876607543401088:12345-192.168.202.39@tcp:35:cat.0 Request processed in 743us (900us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789672819.152114:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 8 00000100:00100000:1.0:1789672819.255892:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672819.256010:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543401344 00000100:00100000:3.0:1789672819.256023:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543401344 00000100:00100000:3.0:1789672819.256105:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:3.0:1789672819.256118:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+21:14477:x1876607543401344:12345-192.168.202.39@tcp:101:dd.0 00010000:00010000:3.0:1789672819.256153:0:16286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672819.256183:0:16286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09dc5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcd8 expref: -99 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256356:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256375:0:16286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 22 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256385:0:16286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256394:0:16286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256457:0:16286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256473:0:16286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 22 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672819.256488:0:16286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a57800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16286:1876607564356096:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672819.256662:0:16286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 22 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.256672:0:16286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 22 pid: 16286 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672819.256682:0:16286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639a55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16286:1876607564356224:192.168.202.39@tcp:104: 00000100:00100000:3.0:1789672819.256719:0:16286:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa61a755c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672819.261684:0:16286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a57800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16286:1876607564356096:192.168.202.39@tcp:104: 00000100:00100000:2.0:1789672819.261707:0:16286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639a55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16286:1876607564356224:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672819.261743:0:16286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672819.262045:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.262091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.262186:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543401472 00000100:00100000:0.0:1789672819.262197:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543401472 00010000:00010000:0.0:1789672819.262252:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 23 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672819.262291:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543401600 00000100:00100000:0.0:1789672819.262295:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543401600 00010000:00010000:0.0:1789672819.262309:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 24 pid: 16286 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672819.262327:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:0.0:1789672819.262338:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b85647-7bc5-4989-9bf9-fea45033777a+24:2358:x1876607543401472:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672819.262361:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672819.262369:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 24 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262383:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 24 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262414:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09d7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcbc expref: 24 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262434:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.262439:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262472:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262480:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672819.262573:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b85647-7bc5-4989-9bf9-fea45033777a+23:2358:x1876607543401472:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 236us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.262582:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:0.0:1789672819.262645:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:0.0:1789672819.262652:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b85647-7bc5-4989-9bf9-fea45033777a+22:2358:x1876607543401600:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672819.262661:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672819.262667:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 22 pid: 16286 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262677:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 22 pid: 16286 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262702:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09d6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcb5 expref: 22 pid: 16286 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262713:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.262717:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262726:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262735:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.262768:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672819.262856:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b85647-7bc5-4989-9bf9-fea45033777a+21:2358:x1876607543401600:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 203us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.262863:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00010000:00010000:2.0:1789672819.264059:0:16286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.264093:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672819.264134:0:16286:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789672819.264409:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09dc5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcd8 expref: 22 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.264437:0:16286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67c400/0x2247cb9491d09dcc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcd8 expref: 21 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.264447:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672819.264451:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672819.264455:0:16286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa63f67c400, rc 0) 00000100:00100000:2.0:1789672819.264551:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+21:14477:x1876607543401344:12345-192.168.202.39@tcp:101:dd.0 Request processed in 8434us (8674us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789672819.264561:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 34 00000100:00100000:3.0:1789672819.270850:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.270943:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543401856 00000100:00100000:2.0:1789672819.270957:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543401856 00000100:00100000:2.0:1789672819.271030:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 35 00000100:00100000:2.0:1789672819.271042:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+21:14477:x1876607543401856:12345-192.168.202.39@tcp:36:dd.0 00010000:00010000:2.0:1789672819.272474:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.272754:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.273175:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672819.273315:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789672819.273393:0:14412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005348bb0 reply state 000000001c5630b1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.273403:0:14412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672819.273575:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+24:14477:x1876607543401856:12345-192.168.202.39@tcp:36:dd.0 Request processed in 2522us (2789us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789672819.273586:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 35 00000020:00080000:2.0:1789672819.273593:0:14412:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789672819.281026:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:0.0:1789672819.281176:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.281192:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.281202:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.281209:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333ac00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672819.281215:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.281223:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.281250:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.281254:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672819.281260:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.281267:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09dda lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.282216:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543401984 00000100:00100000:2.0:1789672819.282232:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543401984 00000100:00100000:2.0:1789672819.282329:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:2.0:1789672819.282342:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+23:14477:x1876607543401984:12345-192.168.202.39@tcp:101:dd.0 00010000:00010000:2.0:1789672819.282392:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672819.282418:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09de1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcdf expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.282979:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09de1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcdf expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.283000:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09de1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcdf expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.283025:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672819.283029:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672819.283032:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333b200, rc 0) 00000100:00100000:2.0:1789672819.284221:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+24:14477:x1876607543401984:12345-192.168.202.39@tcp:101:dd.0 Request processed in 1873us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.284275:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 36 00000100:00100000:1.0:1789672819.295412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.295518:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543402240 00000100:00100000:0.0:1789672819.295532:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543402240 00000100:00100000:0.0:1789672819.296216:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:0.0:1789672819.296231:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b85647-7bc5-4989-9bf9-fea45033777a+24:14477:x1876607543402240:12345-192.168.202.39@tcp:103:dd.0 00010000:00010000:0.0:1789672819.296252:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672819.296286:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09de1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcdf expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.296313:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.296319:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672819.296401:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43b85647-7bc5-4989-9bf9-fea45033777a+23:14477:x1876607543402240:12345-192.168.202.39@tcp:103:dd.0 Request processed in 173us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.296410:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:3.0:1789672819.305261:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.305635:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543402368 00000100:00100000:0.0:1789672819.305650:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543402368 00000100:00100000:0.0:1789672819.305732:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:0.0:1789672819.305745:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+23:14477:x1876607543402368:12345-192.168.202.39@tcp:58:dd.0 00010000:00010000:0.0:1789672819.305905:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.305927:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.305943:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672819.315069:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789672819.315255:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789672819.315342:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789672819.315532:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+23:14477:x1876607543402368:12345-192.168.202.39@tcp:58:dd.0 Request processed in 9780us (10276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672819.315546:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 37 00000100:00100000:1.0:1789672819.321910:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.322170:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543402496 00000100:00100000:0.0:1789672819.322184:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543402496 00000100:00100000:0.0:1789672819.322440:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 38 00000100:00100000:0.0:1789672819.322454:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+23:14477:x1876607543402496:12345-192.168.202.39@tcp:101:dd.0 00010000:00010000:0.0:1789672819.322524:0:16286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672819.322550:0:16286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfce6 expref: -99 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.322616:0:16286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.322625:0:16286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 24 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.322644:0:16286:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.322655:0:16286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 24 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.322669:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:0.0:1789672819.322671:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672819.322674:0:16286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 24 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.322680:0:16286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa61d910400, rc 0) 00000100:00100000:0.0:1789672819.322747:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+24:14477:x1876607543402496:12345-192.168.202.39@tcp:101:dd.0 Request processed in 297us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.322751:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 38 00000040:00080000:0.0:1789672819.443155:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789672819.443167:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672819.443222:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789672819.443247:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789672819.443411:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa6352cc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14444:1876607564356352:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672819.447520:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa604a7a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672819.456341:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa6352cc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14444:1876607564356352:192.168.202.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789672819.459502:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.460138:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543402624 00000100:00100000:2.0:1789672819.460154:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543402624 00000100:00100000:2.0:1789672819.460224:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:2.0:1789672819.460236:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543402624:12345-192.168.202.39@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789672819.460419:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543402624:12345-192.168.202.39@tcp:900:lhsmtool_posix.0 Request processed in 184us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.460429:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:1.0:1789672819.463482:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.463629:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543402752 00000100:00100000:2.0:1789672819.463643:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543402752 00000100:00100000:2.0:1789672819.463727:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:2.0:1789672819.463739:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543402752:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672819.464080:0:14412:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672819.464255:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543402752:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 516us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.464265:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 39 00000100:00100000:1.0:1789672819.468266:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.468389:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543402880 00000100:00100000:2.0:1789672819.468402:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543402880 00000100:00100000:2.0:1789672819.468480:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:2.0:1789672819.468492:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543402880:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789672819.468601:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.468624:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.468665:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469038:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469063:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469077:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469110:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469120:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469125:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672819.469172:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789672819.469177:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672819.469194:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469206:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469213:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469237:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469243:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.469248:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469256:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469273:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6200) 00010000:00010000:2.0:1789672819.469277:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672819.469282:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469290:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b000/0x2247cb9491d09df6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469308:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469314:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469320:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469326:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333a800 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.469330:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469346:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469358:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fa611f22700) 00010000:00010000:2.0:1789672819.469361:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672819.469364:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469371:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a800/0x2247cb9491d09dfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469388:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469394:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469400:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469405:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333a000 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.469408:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469415:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469421:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672819.469424:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672819.469427:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.469453:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333a000/0x2247cb9491d09e04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.469657:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543402880:12345-192.168.202.39@tcp:34:lhsmtool_posix.0 Request processed in 1162us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.469668:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 40 00000100:00100000:3.0:1789672819.473184:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.473274:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543403136 00000100:00100000:1.0:1789672819.473283:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543403136 00000100:00100000:1.0:1789672819.473326:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 41 00000100:00100000:1.0:1789672819.473332:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+24:14478:x1876607543403136:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672819.473348:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672819.473366:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfced expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.473470:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.473482:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.473489:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672819.473498:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789672819.473761:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.473770:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474112:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474119:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:1.0:1789672819.474123:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474150:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474164:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:1.0:1789672819.474167:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672819.474173:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474179:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474226:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e0b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfced expref: 26 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474236:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa6184b6200) 00010000:00010000:1.0:1789672819.474238:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672819.474242:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfced expref: 26 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.474251:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044800, rc 0) 00000100:00100000:1.0:1789672819.474416:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+25:14478:x1876607543403136:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 1081us (1240us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789672819.474424:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 41 00000100:00100000:1.0:1789672819.501737:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.502137:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543403264 00000100:00100000:0.0:1789672819.502147:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543403264 00000100:00100000:0.0:1789672819.502219:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:0.0:1789672819.502231:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+25:14478:x1876607543403264:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672819.502273:0:16286:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672819.502398:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+25:14478:x1876607543403264:12345-192.168.202.39@tcp:53:lhsmtool_posix.0 Request processed in 169us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.502405:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 42 00000100:00100000:2.0:1789672819.511480:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.511593:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543403520 00000100:00100000:1.0:1789672819.511604:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543403520 00000100:00100000:1.0:1789672819.511672:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:1.0:1789672819.511693:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+25:14478:x1876607543403520:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672819.511735:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672819.511758:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcf4 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672819.513988:0:14412:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1789672819.514000:0:14412:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789672819.514063:0:14412:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789672819.514379:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.514395:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.514408:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.514477:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcf4 expref: 28 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.514498:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcf4 expref: 27 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.514521:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6500) 00010000:00010000:1.0:1789672819.514524:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672819.514527:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044600, rc 0) 00000100:00100000:1.0:1789672819.515355:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+27:14478:x1876607543403520:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 3667us (3879us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789672819.515366:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 43 00000100:00100000:3.0:1789672819.525946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.526126:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543403776 00000100:00100000:0.0:1789672819.526136:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543403776 00000100:00100000:0.0:1789672819.526202:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:0.0:1789672819.526212:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+27:14478:x1876607543403776:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672819.526272:0:16286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672819.526299:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044600/0x2247cb9491d09e27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcf4 expref: 27 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526321:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6500) 00010000:00010000:0.0:1789672819.526335:0:16286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672819.526362:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526378:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526406:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526422:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526430:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526437:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526511:0:16286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526520:0:16286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526527:0:16286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526533:0:16286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672819.526538:0:16286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526545:0:16286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526554:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa6184b6400) 00010000:00010000:0.0:1789672819.526556:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672819.526560:0:16286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526573:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d911a00/0x2247cb9491d09e35 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526584:0:16286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526589:0:16286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526596:0:16286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526601:0:16286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672819.526604:0:16286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526610:0:16286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526618:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x17328eb7 (ffff9fa610c05c00) 00010000:00010000:0.0:1789672819.526620:0:16286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672819.526624:0:16286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.526629:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e3c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x17328eb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672819.527023:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+26:14478:x1876607543403776:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 809us (1084us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672819.527032:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 44 00000100:00100000:2.0:1789672819.538603:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.538713:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543403904 00000100:00100000:1.0:1789672819.538737:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543403904 00000100:00100000:1.0:1789672819.538843:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:1.0:1789672819.538854:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+26:14478:x1876607543403904:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672819.538875:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672819.538899:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e43 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfcfb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.538936:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642045400/0x2247cb9491d09e4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.538950:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642045400/0x2247cb9491d09e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.538963:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642045400/0x2247cb9491d09e4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.539055:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcfb expref: 28 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.539075:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642045400/0x2247cb9491d09e4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfcfb expref: 27 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.539085:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:1.0:1789672819.539088:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672819.539091:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642045400, rc 0) 00000100:00100000:1.0:1789672819.539163:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+27:14478:x1876607543403904:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 311us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672819.539170:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 45 00000100:00100000:2.0:1789672819.547341:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.547435:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543404160 00000100:00100000:0.0:1789672819.547446:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543404160 00000100:00100000:0.0:1789672819.547523:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 46 00000100:00100000:0.0:1789672819.547533:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa50346a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+27:14478:x1876607543404160:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672819.547623:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.547640:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.547651:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672819.549520:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789672819.549540:0:14411:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 488330753462ns, next at 489330748222ns, rc = 0 00000004:00010000:0.0:1789672819.549658:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000721b2e68 reply state 0000000012499334 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672819.550819:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672819.550954:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa50346a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43b85647-7bc5-4989-9bf9-fea45033777a+29:14478:x1876607543404160:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 3419us (3620us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789672819.550960:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 46 00010000:00010000:0.0:1789672819.557004:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.557021:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.557029:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.557052:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910200 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672819.557058:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.557066:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.557083:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:0.0:1789672819.557086:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789672819.557091:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.557108:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910200/0x2247cb9491d09e51 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.567077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.570011:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543404288 00000100:00100000:1.0:1789672819.570045:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543404288 00000100:00100000:1.0:1789672819.571021:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:1.0:1789672819.571035:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+28:14478:x1876607543404288:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672819.571061:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672819.571082:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfd02 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.571149:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 29 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.571165:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 29 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.571187:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:1.0:1789672819.571190:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672819.571193:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa642044800, rc 0) 00000100:00100000:1.0:1789672819.571274:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+29:14478:x1876607543404288:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 242us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672819.571281:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 47 00000100:00100000:3.0:1789672819.579870:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.585725:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543404416 00000100:00100000:1.0:1789672819.585743:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543404416 00000100:00100000:1.0:1789672819.585858:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00100000:1.0:1789672819.585871:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+5:2357:x1876607543404416:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789672819.586240:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+6:2357:x1876607543404416:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 371us (6378us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789672819.586248:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 12 00000100:00080000:2.0:1789672819.587713:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672819.589054:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.589167:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543404672 00000100:00100000:2.0:1789672819.589178:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543404672 00000100:00100000:2.0:1789672819.589241:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:2.0:1789672819.589252:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+29:14478:x1876607543404672:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789672819.589494:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+30:14478:x1876607543404672:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 243us (445us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789672819.589534:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 9 00000100:00100000:0.0:1789672819.595708:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.595835:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543404928 00000100:00100000:2.0:1789672819.595846:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543404928 00000100:00100000:2.0:1789672819.595894:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:2.0:1789672819.595903:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+30:14478:x1876607543404928:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789672819.596025:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+30:14478:x1876607543404928:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 121us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.596033:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 48 00000100:00100000:3.0:1789672819.599216:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.601849:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543405056 00000100:00100000:2.0:1789672819.601864:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543405056 00000100:00100000:2.0:1789672819.601940:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:2.0:1789672819.601950:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+30:14478:x1876607543405056:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672819.601971:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672819.602003:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09e5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfd09 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.602071:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09e66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.602087:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09e66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.602099:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09e66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672819.602135:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789672819.602152:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09e66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.602176:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b200/0x2247cb9491d09e5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd09 expref: 32 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.602196:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09e66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd09 expref: 31 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.602204:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:2.0:1789672819.602207:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789672819.602211:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333ac00, rc 0) 00000100:00100000:2.0:1789672819.602289:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+31:14478:x1876607543405056:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 340us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.602296:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 49 00000100:00100000:3.0:1789672819.611869:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.612019:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543405184 00000100:00100000:2.0:1789672819.612029:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543405184 00000100:00100000:2.0:1789672819.612088:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:2.0:1789672819.612098:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+6:2359:x1876607543405184:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672819.612117:0:15095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672819.612138:0:15095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd358c3986c7bfd10 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672819.612167:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3d74, blocks: 0x1 00010000:00010000:2.0:1789672819.612190:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1789672819.612194:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672819.612204:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 7 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.612224:0:15095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 7 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.612238:0:15095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa50333b200, rc 0) 00000100:00100000:2.0:1789672819.612308:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+7:2359:x1876607543405184:12345-192.168.202.39@tcp:101:lhsmtool_posix.0 Request processed in 211us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.612316:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:0.0:1789672819.623214:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.623588:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543405440 00000100:00100000:2.0:1789672819.623598:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543405440 00000100:00100000:2.0:1789672819.623690:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 50 00000100:00100000:2.0:1789672819.623701:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+31:14478:x1876607543405440:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789672819.623849:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+31:14478:x1876607543405440:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 149us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.623858:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 50 00000100:00100000:3.0:1789672819.630889:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.632375:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543405568 00000100:00100000:2.0:1789672819.632389:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543405568 00000100:00100000:2.0:1789672819.632461:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:2.0:1789672819.632471:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+31:14478:x1876607543405568:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789672819.709858:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1789672819.709875:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789672819.709905:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1789672819.709922:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1789672819.709933:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1789672819.710135:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564356480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789672819.710219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672819.710451:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564356480 00000100:00100000:2.0:1789672819.710459:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564356480 00000100:00100000:2.0:1789672819.710546:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672819.710556:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876607564356480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789672819.710714:0:15712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789672819.710718:0:15712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789672819.710720:0:15712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789672819.710722:0:15712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789672820 -> 1789672820 00002000:00010000:2.0:1789672819.710724:0:15712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789672819.710766:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876607564356480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (547us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789672819.710773:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789672819.711106:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789672819.711140:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa639d4ea00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789672819.711147:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1876607564356480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789672819.711301:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+14:14478:x1876607543405568:12345-192.168.202.39@tcp:44:lhsmtool_posix.0 Request processed in 78829us (80420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672819.711310:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 51 00000100:00100000:3.0:1789672819.716189:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.722294:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543405696 00000100:00100000:2.0:1789672819.722326:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543405696 00000100:00100000:2.0:1789672819.722402:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:2.0:1789672819.722412:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa62f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+7:2357:x1876607543405696:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789672819.722556:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa62f0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+7:2357:x1876607543405696:12345-192.168.202.39@tcp:16:lhsmtool_posix.0 Request processed in 144us (6375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672819.722563:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 15 00000100:00100000:0.0:1789672819.726360:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.726618:0:16286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543405952 00000100:00100000:2.0:1789672819.726630:0:16286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543405952 00000100:00100000:2.0:1789672819.726699:0:16286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 52 00000100:00100000:2.0:1789672819.726711:0:16286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+14:14478:x1876607543405952:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789672819.726765:0:16286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672819.726826:0:16286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333ac00/0x2247cb9491d09e66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd09 expref: 14 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.726846:0:16286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:2.0:1789672819.726852:0:16286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672819.726880:0:16286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.726894:0:16286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.726906:0:16286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672819.727102:0:16286:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005465dfd reply state 0000000057dbe2d9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.727113:0:16286:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672819.727230:0:16286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:43b85647-7bc5-4989-9bf9-fea45033777a+15:14478:x1876607543405952:12345-192.168.202.39@tcp:36:lhsmtool_posix.0 Request processed in 520us (879us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789672819.727237:0:16286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 52 00010000:00010000:0.0:1789672819.730121:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.730138:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.730146:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.730153:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333aa00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:0.0:1789672819.730158:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.730183:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.730198:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:0.0:1789672819.730202:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672819.730207:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.730213:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333aa00/0x2247cb9491d09e74 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16286 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672819.731003:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672819.733543:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543406080 00000100:00100000:2.0:1789672819.733560:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543406080 00000100:00100000:2.0:1789672819.733632:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:2.0:1789672819.733643:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:2358:x1876607543406080:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789672819.733863:0:15712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789672819.733866:0:15712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789672819 00002000:00010000:2.0:1789672819.733869:0:15712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789672819 00002000:00010000:2.0:1789672819.733871:0:15712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789672820 -> 1789672819 00002000:00010000:2.0:1789672819.733874:0:15712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789672819.733940:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43b85647-7bc5-4989-9bf9-fea45033777a+8:2358:x1876607543406080:12345-192.168.202.39@tcp:2:lhsmtool_posix.0 Request processed in 299us (2944us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789672819.733948:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 16 00000100:00100000:2.0:1789672819.744570:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.744699:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543406208 00000100:00100000:1.0:1789672819.744708:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543406208 00000100:00100000:1.0:1789672819.744772:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:1.0:1789672819.744804:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+8:2358:x1876607543406208:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789672819.744853:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744870:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672819.744874:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672819.744879:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744894:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744926:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744934:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744941:0:15095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744963:0:15095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672819.744967:0:15095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744977:0:15095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.744992:0:15095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.745001:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09e7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672819.745077:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+8:2358:x1876607543406208:12345-192.168.202.39@tcp:1:lhsmtool_posix.0 Request processed in 295us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672819.745084:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:2.0:1789672819.763035:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.763452:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543406464 00000100:00100000:1.0:1789672819.763462:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543406464 00000100:00100000:1.0:1789672819.763542:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 53 00000100:00100000:1.0:1789672819.763552:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+14:14478:x1876607543406464:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672819.763635:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.763652:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.763682:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.764080:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.764550:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.764561:0:14413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.764602:0:14413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.764616:0:14413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 15 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672819.764630:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635641880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14413:1876607564356608:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672819.764805:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa503236180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672819.780455:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672819.781603:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543406592 00000100:00100000:3.0:1789672819.781616:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543406592 00010000:00010000:3.0:1789672819.781663:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 16 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672819.781709:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 13 00000100:00100000:3.0:1789672819.781719:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b85647-7bc5-4989-9bf9-fea45033777a+16:2358:x1876607543406592:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672819.781735:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672819.781742:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 16 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.781755:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 16 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.781834:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:3.0:1789672819.781840:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.781849:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.781856:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.781878:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672819.781933:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43b85647-7bc5-4989-9bf9-fea45033777a+16:2358:x1876607543406592:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 214us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672819.781941:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 13 00010000:00010000:2.0:1789672819.788241:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044800/0x2247cb9491d09e58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd02 expref: 15 pid: 14413 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.788271:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635641880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14413:1876607564356608:192.168.202.39@tcp:104: 00010000:00010000:2.0:1789672819.788298:0:14413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.788309:0:14413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.788315:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672819.788548:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789672819.788701:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789672819.788764:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789672819.788898:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14413:1876607564356736:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789672819.789002:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672819.789027:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa607aff540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672819.789136:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564356736 00000100:00100000:0.0:1789672819.789144:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564356736 00000100:00100000:0.0:1789672819.789193:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672819.789202:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1876607564356736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789672819.789281:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1876607564356736:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672819.789289:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672819.790701:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14413:1876607564356736:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789672819.792135:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789672819.792222:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14413:1876607564356864:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789672819.792283:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672819.792323:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa607aff240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672819.792674:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564356864 00000100:00100000:1.0:1789672819.792682:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564356864 00000100:00100000:1.0:1789672819.792729:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672819.792737:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14413:x1876607564356864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789672819.792940:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14413:x1876607564356864:12345-0@lo:1000:mdt00_002.0 Request processed in 202us (656us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789672819.792957:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672819.793624:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14413:1876607564356864:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789672819.793661:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793672:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793681:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793688:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044a00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.793693:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793701:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793729:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:2.0:1789672819.793732:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672819.793738:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793745:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044a00/0x2247cb9491d09e89 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793780:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793814:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793821:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793826:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d910600 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.793829:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793836:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793844:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672819.793847:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672819.793854:0:14413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 18 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793866:0:14413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 18 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793884:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 18 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.793917:0:14413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910400/0x2247cb9491d09def lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfce6 expref: 18 pid: 16286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.793932:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa639d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14413:1876607564356992:192.168.202.39@tcp:105: 00000100:00100000:2.0:1789672819.794008:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa607aff240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672819.797004:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa639d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14413:1876607564356992:192.168.202.39@tcp:105: 00010000:00010000:2.0:1789672819.797036:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797047:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa61d910600/0x2247cb9491d09de8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797079:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797092:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797116:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797127:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797134:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797157:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797163:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b400 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.797167:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797174:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797186:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672819.797190:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672819.797193:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797200:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa50333b400/0x2247cb9491d09e90 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797210:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797217:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797223:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797254:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044e00 already unused, calling callback (ffffffffc21e04f0) 00010000:00010000:2.0:1789672819.797258:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797274:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797284:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa611f22000) 00010000:00010000:2.0:1789672819.797286:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672819.797289:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.797294:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa642044e00/0x2247cb9491d09e82 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.797538:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43b85647-7bc5-4989-9bf9-fea45033777a+18:14478:x1876607543406464:12345-192.168.202.39@tcp:57:lhsmtool_posix.0 Request processed in 33986us (34511us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789672819.797549:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 53 00000020:00080000:2.0:1789672819.797555:0:14413:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789672819.798122:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789672819.798128:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672819.798159:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789672819.798164:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789672819.798255:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672819.798412:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543406720 00000100:00100000:3.0:1789672819.798429:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543406720 00000100:00100000:3.0:1789672819.798523:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:3.0:1789672819.798535:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa61068c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+18:14477:x1876607543406720:12345-192.168.202.39@tcp:49:dd.0 00000100:00100000:3.0:1789672819.798709:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa61068c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+18:14477:x1876607543406720:12345-192.168.202.39@tcp:49:dd.0 Request processed in 176us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672819.798717:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 10 00000100:00100000:2.0:1789672819.805061:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672819.806747:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543406976 00000100:00100000:3.0:1789672819.806762:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543406976 00000100:00100000:3.0:1789672819.806859:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 11 00000100:00100000:3.0:1789672819.806870:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+18:14478:x1876607543406976:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789672819.812531:0:14414:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789672819.812652:0:14414:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789672819.812733:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.812753:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.812766:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.812776:0:14414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.812783:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.812807:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.812828:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789672819.812941:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43b85647-7bc5-4989-9bf9-fea45033777a+20:14478:x1876607543406976:12345-192.168.202.39@tcp:35:lhsmtool_posix.0 Request processed in 6068us (7885us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789672819.812951:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 11 00000020:00080000:3.0:1789672819.812956:0:14414:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789672819.813370:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672819.813379:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.813386:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa63f67d600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672819.813390:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.813399:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.813411:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa6184b6300) 00010000:00010000:2.0:1789672819.813414:0:14399:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789672819.813427:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.813433:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa63f67d600/0x2247cb9491d09e97 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.813447:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672819.813449:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672819.813451:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672819.959640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:1.0:1789672819.959741:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407104 00000100:00100000:1.0:1789672819.959752:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407104 00000100:00100000:1.0:1789672819.959856:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:1.0:1789672819.959867:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:43b85647-7bc5-4989-9bf9-fea45033777a+8:2359:x1876607543407104:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:1.0:1789672819.959915:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.959936:0:15099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 8 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.959945:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672819.959950:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672819.959955:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.959991:0:15099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 8 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.960006:0:15099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 8 pid: 15095 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672819.960043:0:15099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15099:1876607564357120:192.168.202.39@tcp:104: 00000100:00100000:1.0:1789672819.960142:0:15099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9fa503236c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672819.964250:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672819.964493:0:15101:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789672819.964519:0:15101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789672819.964842:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407360 00000100:00100000:1.0:1789672819.964852:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407360 00000100:00100000:0.0:1789672819.965351:0:16642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:0.0:1789672819.965370:0:16642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:43b85647-7bc5-4989-9bf9-fea45033777a+9:2360:x1876607543407360:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:0.0:1789672819.965407:0:16642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672819.965423:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00010000:00010000:0.0:1789672819.965426:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672819.965432:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672819.965444:0:16642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672819.965455:0:16642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672819.965556:0:15099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15099:1876607564357120:192.168.202.39@tcp:104: 00010000:00010000:3.0:1789672819.965578:0:15099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672819.965645:0:15101:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789672819.965652:0:15101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789672819.968227:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:3.0:1789672819.968326:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407488 00000100:00100000:3.0:1789672819.968335:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407488 00010000:00010000:3.0:1789672819.968369:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 10 pid: 15095 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672819.968421:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 14 00000100:00100000:3.0:1789672819.968431:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b85647-7bc5-4989-9bf9-fea45033777a+10:2358:x1876607543407488:12345-192.168.202.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672819.968446:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672819.968469:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 10 pid: 15095 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968483:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 10 pid: 15095 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968515:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002693231c/0x2247cb9491d09e6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.39@tcp remote: 0xd358c3986c7bfd10 expref: 10 pid: 15095 timeout: 588 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968531:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672819.968535:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672819.968540:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968550:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968558:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672819.968561:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672819.968564:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968583:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968624:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672819.968671:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43b85647-7bc5-4989-9bf9-fea45033777a+9:2358:x1876607543407488:12345-192.168.202.39@tcp:103:ldlm_bl.0 Request processed in 240us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672819.968679:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 14 00010000:00010000:3.0:1789672819.968710:0:15099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672819.968719:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.976012:0:16642:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672819.976033:0:16642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672819.977555:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407232 00000100:00100000:0.0:1789672819.977575:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407232 00000100:00100000:1.0:1789672819.978286:0:16643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 2 00000100:00100000:1.0:1789672819.978298:0:16643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:43b85647-7bc5-4989-9bf9-fea45033777a+11:2360:x1876607543407232:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:1.0:1789672819.978333:0:16643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.978350:0:16643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672819.978353:0:16643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672819.978359:0:16643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672819.978374:0:16643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.019210:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789672820.097135:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1789672820.097163:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1789672820.103362:0:16642:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1789672820.103374:0:16642:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789672819 -> 1789672820 00002000:00010000:1.0:1789672820.103377:0:16642:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:1.0:1789672820.103396:0:16642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.103491:0:16642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.103510:0:16642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.103519:0:16642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672820.103525:0:16642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.103537:0:16642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.103562:0:16642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.103570:0:16642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece656f8/0x2247cb9491d09ea5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672820.103727:0:16642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:43b85647-7bc5-4989-9bf9-fea45033777a+13:2360:x1876607543407360:12345-192.168.202.39@tcp:4:dd.0 Request processed in 138361us (139479us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789672820.103739:0:16642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 1 00000100:00100000:1.0:1789672820.146985:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564357632:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672820.147150:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789672820.147174:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564357248:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672820.147243:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564357760:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672820.147287:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564357376:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672820.147338:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672820.147343:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa635641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564357504:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147363:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672820.147399:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564357248 00000100:00100000:1.0:1789672820.147409:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564357248 00000100:00100000:1.0:1789672820.147642:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789672820.147653:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3301:x1876607564357248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147728:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1+19:3301:x1876607564357248:12345-0@lo:400:kworker.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672820.147735:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789672820.147776:0:15712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564357376 00000100:00100000:1.0:1789672820.147780:0:15712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564357376 00000100:00100000:1.0:1789672820.147912:0:15712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672820.147921:0:15712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564357376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.147961:0:15712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876607564357376:12345-0@lo:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672820.147967:0:15712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672820.147988:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564357632 00000100:00100000:1.0:1789672820.147992:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564357632 00000100:00100000:1.0:1789672820.148020:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564357760 00000100:00100000:1.0:1789672820.148022:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564357760 00000100:00100000:1.0:1789672820.148050:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564357504 00000100:00100000:1.0:1789672820.148053:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564357504 00000100:00100000:1.0:1789672820.148066:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672820.148071:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564357632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148102:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876607564357632:12345-0@lo:400:kworker.0 Request processed in 31us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672820.148108:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672820.148119:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672820.148124:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa635642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564357760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148149:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa635642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876607564357760:12345-0@lo:400:kworker.0 Request processed in 25us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672820.148155:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672820.148165:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789672820.148171:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148385:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876607564357504:12345-0@lo:400:kworker.0 Request processed in 214us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672820.148393:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789672820.148412:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672820.148490:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672820.148545:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876607564357504:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148558:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1876607564357376:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148592:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:994b4890-4fae-4a7b-b1da-2d17fd8dcbb1:3301:1876607564357248:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148602:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1876607564357760:0@lo:400:kworker.0 00000100:00100000:1.0:1789672820.148610:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa635643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1876607564357632:0@lo:400:kworker.0 00000100:00100000:3.0:1789672820.148984:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672820.148998:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa604a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564357888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672820.149043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672820.149081:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564357888 00000100:00100000:3.0:1789672820.149087:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564357888 00000100:00100000:3.0:1789672820.149123:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672820.149130:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa503469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564357888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672820.149166:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789672820.149275:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa503469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564357888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672820.149283:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672820.149318:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa604a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564357888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789672820.149990:0:16643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.150008:0:16643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.150019:0:16643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.150027:0:16643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672820.150032:0:16643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.150042:0:16643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.150066:0:16643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.150075:0:16643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672820.150157:0:16643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:43b85647-7bc5-4989-9bf9-fea45033777a+11:2360:x1876607543407232:12345-192.168.202.39@tcp:4:dd.0 Request processed in 171859us (184733us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789672820.150166:0:16643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 2 00000001:00080000:0.0:1789672820.150537:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789672820.150559:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:2.0:1789672820.150947:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.150958:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.150967:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.150974:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789672820.150979:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.151002:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.151015:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.151023:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09e9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672820.151098:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543407104:12345-192.168.202.39@tcp:4:dd.0 Request processed in 191232us (191467us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789672820.151113:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 0 00000100:00100000:2.0:1789672820.165632:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672820.167105:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407616 00000100:00100000:0.0:1789672820.167122:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407616 00000100:00100000:1.0:1789672820.167549:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:1.0:1789672820.167565:0:15101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543407616:12345-192.168.202.39@tcp:4:dd.0 00002000:00010000:1.0:1789672820.167648:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aac3d74, atime: 0x6aac3d73, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789672820.167659:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.167679:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1789672820.167684:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672820.167691:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.167708:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672820.170261:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672820.170423:0:16642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407744 00000100:00100000:2.0:1789672820.170436:0:16642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407744 00000100:00100000:2.0:1789672820.170539:0:16642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 4 00000100:00100000:2.0:1789672820.170551:0:16642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63a055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:43b85647-7bc5-4989-9bf9-fea45033777a+7:2359:x1876607543407744:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:2.0:1789672820.170597:0:16642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.170620:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672820.170624:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672820.170632:0:16642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.170671:0:16642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672820.171355:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672820.173195:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543407872 00000100:00100000:0.0:1789672820.173215:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543407872 00000100:00100000:0.0:1789672820.173319:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 5 00000100:00100000:0.0:1789672820.173333:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:43b85647-7bc5-4989-9bf9-fea45033777a+9:2359:x1876607543407872:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:0.0:1789672820.173380:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.173403:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672820.173408:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672820.173628:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.173648:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672820.190805:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672820.190866:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:2.0:1789672820.192215:0:15100:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789672820.192234:0:15100:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789672820.192666:0:16643:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789672820.192687:0:16643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408000 00000100:00100000:1.0:1789672820.192701:0:16643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408000 00000100:00100000:1.0:1789672820.192765:0:16643:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789672820.192770:0:16643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408128 00000100:00100000:1.0:1789672820.192773:0:16643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408128 00000100:00100000:2.0:1789672820.203920:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:2.0:1789672820.203941:0:16645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:43b85647-7bc5-4989-9bf9-fea45033777a+14:2359:x1876607543408000:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:2.0:1789672820.203988:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.204007:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672820.204012:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672820.204033:0:16645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672820.204051:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672820.273517:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1789672820.275304:0:15101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:1.0:1789672820.275316:0:15101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789672820 00002000:00010000:1.0:1789672820.275319:0:15101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789672820.275334:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.275348:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.275378:0:15101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.275385:0:15101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672820.275390:0:15101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.275399:0:15101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.275422:0:15101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.275430:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4bdd4/0x2247cb9491d09eb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672820.276306:0:15101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:43b85647-7bc5-4989-9bf9-fea45033777a+18:2359:x1876607543407616:12345-192.168.202.39@tcp:4:dd.0 Request processed in 108739us (110680us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789672820.276319:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 3 00000100:00100000:1.0:1789672820.276364:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 7 00000100:00100000:1.0:1789672820.276378:0:15101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:43b85647-7bc5-4989-9bf9-fea45033777a+17:2359:x1876607543408128:12345-192.168.202.39@tcp:4:dd.0 00010000:00010000:1.0:1789672820.276413:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.276427:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789672820.276441:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672820.276447:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.276459:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672820.344104:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:0.0:1789672820.344131:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1789672820.344951:0:16642:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1789672820.344958:0:16642:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1789672820.344972:0:16642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.344985:0:16642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.344994:0:16642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.345001:0:16642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333a000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672820.345005:0:16642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.345014:0:16642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.345035:0:16642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.345042:0:16642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058a293df/0x2247cb9491d09eba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345172:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345181:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345189:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345195:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa61d911400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789672820.345198:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345206:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345229:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672820.345236:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae4144b8/0x2247cb9491d09ec1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672820.347893:0:16642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63a055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:43b85647-7bc5-4989-9bf9-fea45033777a+13:2359:x1876607543407744:12345-192.168.202.39@tcp:4:dd.0 Request processed in 177334us (177636us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789672820.347929:0:16642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 4 00002000:00010000:3.0:1789672820.348883:0:16645:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789672820.348899:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.348912:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.348921:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.348928:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa50333b800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789672820.348933:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.348942:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.348962:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672820.348970:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba9e3f7/0x2247cb9491d09ec8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672820.349030:0:16645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:43b85647-7bc5-4989-9bf9-fea45033777a+11:2359:x1876607543408000:12345-192.168.202.39@tcp:4:dd.0 Request processed in 145095us (158264us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789672820.349051:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 6 00000100:00100000:1.0:1789672820.351827:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa604a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:43b85647-7bc5-4989-9bf9-fea45033777a+9:2359:x1876607543407872:12345-192.168.202.39@tcp:4:dd.0 Request processed in 178456us (180434us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789672820.351842:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 5 00000001:00080000:0.0:1789672820.396202:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1789672820.396471:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.396486:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.396505:0:15101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.396513:0:15101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa642044600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789672820.396518:0:15101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.396996:0:15101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.397018:0:15101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672820.397026:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05f43cc/0x2247cb9491d09ecf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672820.397178:0:15101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543408128:12345-192.168.202.39@tcp:4:dd.0 Request processed in 120801us (206306us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789672820.397190:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 7 00010000:00010000:2.0:1789672821.042915:0:15717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789672821.789740:0:16682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789672822.067001:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672822.707630:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9fa63a056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564358016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672822.707708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672822.708003:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607564358016 00000100:00100000:1.0:1789672822.708013:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607564358016 00000100:00100000:1.0:1789672822.708078:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672822.708088:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa639a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564358016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672822.708122:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789672822.708176:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa639a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876607564358016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672822.708184:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672822.708222:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789672822.708228:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa639d4ea00, transno 8589934595 00000004:00080000:1.0:1789672822.708240:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789672822.708266:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9fa63a056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1876607564358016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789672822.708744:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672822.960239:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960326:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960361:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960383:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960400:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960417:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960439:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.39@tcp (source: 12345-192.168.202.39@tcp) 00000100:00100000:0.0:1789672822.960518:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408768 00000100:00100000:0.0:1789672822.960530:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408768 00000100:00100000:0.0:1789672822.960596:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408384 00000100:00100000:0.0:1789672822.960599:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408384 00000100:00100000:0.0:1789672822.960619:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:0.0:1789672822.960630:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa63f780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2359:x1876607543408768:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672822.960880:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408512 00000100:00100000:2.0:1789672822.960888:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408512 00000100:00100000:2.0:1789672822.960916:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543409024 00000100:00100000:2.0:1789672822.960919:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543409024 00000100:00100000:2.0:1789672822.960930:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408640 00000100:00100000:2.0:1789672822.960933:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408640 00000100:00100000:2.0:1789672822.960944:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408896 00000100:00100000:2.0:1789672822.960974:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408896 00000100:00100000:2.0:1789672822.960996:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:2.0:1789672822.961004:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543408512:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672822.961101:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa6352ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543408512:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 98us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672822.961110:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 17 00000100:00100000:2.0:1789672822.961141:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:2.0:1789672822.961147:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2359:x1876607543409024:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672822.961174:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2359:x1876607543409024:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 27us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672822.961181:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 18 00000100:00100000:2.0:1789672822.961193:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:2.0:1789672822.961199:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543408640:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672822.961222:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:43b85647-7bc5-4989-9bf9-fea45033777a+5:2359:x1876607543408640:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 23us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672822.961228:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 19 00000100:00100000:2.0:1789672822.961239:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:2.0:1789672822.961245:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2359:x1876607543408896:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:2.0:1789672822.961267:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:86349658-cb5b-43a4-8b32-2315a9607a2b+5:2359:x1876607543408896:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 22us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672822.961273:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 20 00000100:00100000:0.0:1789672822.961539:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa63f780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86349658-cb5b-43a4-8b32-2315a9607a2b+6:2359:x1876607543408768:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 911us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672822.961548:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 30 00000100:00100000:0.0:1789672822.961565:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00100000:0.0:1789672822.961572:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa641b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+20:2359:x1876607543408384:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:0.0:1789672822.961600:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa641b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43b85647-7bc5-4989-9bf9-fea45033777a+20:2359:x1876607543408384:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 29us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672822.961606:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 31 00000100:00080000:0.0:1789672822.961647:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672822.961734:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672822.961738:0:14407:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672822.962531:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607543408256 00000100:00100000:1.0:1789672822.962544:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607543408256 00000100:00100000:1.0:1789672822.963257:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.39@tcp, seq: 122 00000100:00100000:1.0:1789672822.963271:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa607b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2359:x1876607543408256:12345-192.168.202.39@tcp:400:kworker.0 00000100:00100000:1.0:1789672822.963354:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa607b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0a60fc27-5b1a-4fc9-ac2f-bb8bc98ca9ed+13:2359:x1876607543408256:12345-192.168.202.39@tcp:400:kworker.0 Request processed in 88us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672822.963362:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.39@tcp, seq: 122 00010000:00010000:0.0:1789672823.091694:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29332 lines, 29332 kept, 0 dropped, 0 bad.